Jul 09 20:02:59.424786 ip-10-0-142-249 systemd[1]: Starting Kubernetes Kubelet... Jul 09 20:02:59.831748 ip-10-0-142-249 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 20:02:59.831748 ip-10-0-142-249 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 20:02:59.831748 ip-10-0-142-249 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 20:02:59.831748 ip-10-0-142-249 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 20:02:59.831748 ip-10-0-142-249 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 20:02:59.833828 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.833733 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 20:02:59.839610 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839589 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 20:02:59.839610 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839609 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 20:02:59.839610 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839613 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839616 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839621 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839624 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839627 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839630 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839633 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839636 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839638 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839641 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839644 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839647 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839649 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839652 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839655 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839657 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839660 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839672 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839675 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839678 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 20:02:59.839718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839680 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839685 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839690 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839693 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839695 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839698 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839700 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839703 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839705 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839708 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839710 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839713 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839716 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839719 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839724 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839727 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839731 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839733 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839736 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 20:02:59.840270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839738 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839741 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839744 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839747 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839749 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839752 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839755 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839757 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839762 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839765 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839768 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839771 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839774 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839778 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839781 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839784 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839787 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839790 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839793 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 20:02:59.840792 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839796 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839799 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839801 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839804 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839807 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839810 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839813 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839816 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839819 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839823 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839826 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839828 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839831 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839834 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839837 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839840 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839843 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839845 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839848 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839850 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 20:02:59.841289 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839853 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839856 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839858 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839860 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839863 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839866 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839868 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839870 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839873 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839875 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839878 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839880 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839882 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839885 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839887 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839890 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839892 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839895 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.839899 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 20:02:59.841832 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840670 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840680 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840683 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840687 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840690 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840693 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840696 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840698 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840701 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840705 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840708 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840710 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840713 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840715 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840718 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840720 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840723 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840725 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840728 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840731 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 20:02:59.842324 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840734 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840737 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840739 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840742 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840745 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840747 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840750 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840752 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840757 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840760 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840764 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840767 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840770 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840773 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840776 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840778 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840781 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840784 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840787 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 20:02:59.842913 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840789 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840792 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840794 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840798 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840800 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840803 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840806 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840808 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840811 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840813 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840816 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840818 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840821 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840824 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840827 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840829 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840831 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840834 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840836 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840839 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840842 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 20:02:59.843417 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840844 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840847 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840853 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840855 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840859 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840862 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840864 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840867 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840887 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840891 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840894 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840896 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840899 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840902 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840904 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840907 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840910 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840912 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840914 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840917 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 20:02:59.843985 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840920 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840922 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840926 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840930 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840933 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840936 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840939 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840941 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840944 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840946 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840949 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840952 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840954 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840957 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840960 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840963 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840967 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840971 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.840974 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 20:02:59.844531 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841383 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841389 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841393 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841396 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841400 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841404 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841407 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841410 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841413 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841416 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841419 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841422 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841425 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841429 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841431 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841434 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841437 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841440 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841469 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 20:02:59.845031 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841472 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841475 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841478 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841480 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841483 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841485 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841488 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841491 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841494 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841496 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841499 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841501 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841504 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841506 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841509 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841511 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841514 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841517 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841519 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 20:02:59.845561 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841522 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841524 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841527 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841529 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841532 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841534 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841537 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841540 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841543 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841545 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841548 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841550 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841553 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841555 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841558 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841560 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841565 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841569 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841572 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841575 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 20:02:59.846056 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841578 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841580 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841583 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841585 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841588 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841590 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841593 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841595 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841598 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841600 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841603 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841605 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841611 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841613 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841616 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841619 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841621 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841624 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841627 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841629 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 20:02:59.846601 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841632 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841635 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841637 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841640 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841642 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841644 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841647 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841650 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841655 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841659 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841662 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841664 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841667 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841670 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841673 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841675 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841678 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841680 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841683 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841685 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 20:02:59.847124 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.841688 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841760 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841768 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841774 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841781 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841785 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841789 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841793 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841798 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841801 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841804 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841808 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841812 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841815 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841818 2583 flags.go:64] FLAG: --cgroup-root="" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841821 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841824 2583 flags.go:64] FLAG: --client-ca-file="" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841827 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841830 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841835 2583 flags.go:64] FLAG: --cluster-domain="" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841838 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841842 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841845 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841848 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 20:02:59.847666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841852 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841855 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841858 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841862 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841865 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841868 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841871 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841874 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841876 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841881 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841884 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841887 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841891 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841894 2583 flags.go:64] FLAG: --enable-server="true" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841897 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841901 2583 flags.go:64] FLAG: --event-burst="100" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841904 2583 flags.go:64] FLAG: --event-qps="50" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841907 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841910 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841913 2583 flags.go:64] FLAG: --eviction-hard="" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841916 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841919 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841922 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841925 2583 flags.go:64] FLAG: --eviction-soft="" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841928 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 20:02:59.848280 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841931 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841934 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841937 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841940 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841944 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841948 2583 flags.go:64] FLAG: --feature-gates="" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841952 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841955 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841958 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841961 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841964 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841967 2583 flags.go:64] FLAG: --help="false" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841970 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-142-249.ec2.internal" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841973 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841976 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841979 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841982 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841985 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841988 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841991 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841994 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.841997 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842001 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842004 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 20:02:59.849042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842006 2583 flags.go:64] FLAG: --kube-reserved="" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842009 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842012 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842015 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842018 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842021 2583 flags.go:64] FLAG: --lock-file="" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842024 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842026 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842030 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842035 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842038 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842041 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842044 2583 flags.go:64] FLAG: --logging-format="text" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842049 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842052 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842055 2583 flags.go:64] FLAG: --manifest-url="" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842058 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842062 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842065 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842069 2583 flags.go:64] FLAG: --max-pods="110" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842072 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842075 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842078 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842081 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842084 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 20:02:59.850122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842087 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842090 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842098 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842101 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842104 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842107 2583 flags.go:64] FLAG: --pod-cidr="" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842110 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842116 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842119 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842122 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842124 2583 flags.go:64] FLAG: --port="10250" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842128 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842131 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01c5a45af3300e140" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842134 2583 flags.go:64] FLAG: --qos-reserved="" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842137 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842140 2583 flags.go:64] FLAG: --register-node="true" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842143 2583 flags.go:64] FLAG: --register-with-taints="" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842147 2583 flags.go:64] FLAG: --registry-burst="10" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842149 2583 flags.go:64] FLAG: --registry-qps="5" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842152 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842156 2583 flags.go:64] FLAG: --reserved-memory="" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842161 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842164 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842167 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842170 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 20:02:59.851154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842173 2583 flags.go:64] FLAG: --runonce="false" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842176 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842179 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842182 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842185 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842187 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842190 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842194 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842197 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842200 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842202 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842205 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842208 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842211 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842214 2583 flags.go:64] FLAG: --system-cgroups="" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842216 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842222 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842225 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842228 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842232 2583 flags.go:64] FLAG: --tls-min-version="" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842235 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842237 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842240 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842242 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842245 2583 flags.go:64] FLAG: --v="2" Jul 09 20:02:59.851984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842249 2583 flags.go:64] FLAG: --version="false" Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842253 2583 flags.go:64] FLAG: --vmodule="" Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842257 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.842261 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842435 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842439 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842458 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842462 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842465 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842467 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842470 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842473 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842475 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842478 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842480 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842483 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842487 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842490 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842492 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842495 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842497 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 20:02:59.852691 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842500 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842503 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842505 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842508 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842510 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842513 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842515 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842518 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842521 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842523 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842526 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842528 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842531 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842533 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842537 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842540 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842543 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842546 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842548 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842551 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 20:02:59.853280 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842553 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842556 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842558 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842561 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842564 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842566 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842569 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842576 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842579 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842582 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842585 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842587 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842590 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842592 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842595 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842599 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842602 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842605 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842609 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 20:02:59.853820 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842611 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842614 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842616 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842619 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842622 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842626 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842629 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842634 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842637 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842640 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842643 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842645 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842648 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842650 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842653 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842655 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842658 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842660 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842663 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842665 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 20:02:59.854313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842669 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842671 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842674 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842676 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842679 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842681 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842683 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842686 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842688 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842691 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842693 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842696 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842698 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842701 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842704 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842707 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842709 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842712 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842714 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842718 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 20:02:59.854850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842721 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842723 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.842726 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.843467 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.852325 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.852346 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.852367 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.852373 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852438 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852463 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852468 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852472 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852475 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852478 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852482 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 20:02:59.855483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852485 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852488 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852491 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852494 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852497 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852499 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852502 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852505 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852513 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852516 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852518 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852521 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852524 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852526 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852529 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852531 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852533 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852536 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852540 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852544 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 20:02:59.855900 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852547 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852551 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852554 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852557 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852560 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852562 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852565 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852567 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852570 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852574 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852578 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852581 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852584 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852587 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852590 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852593 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852595 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852598 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852600 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 20:02:59.856489 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852603 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852606 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852608 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852611 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852615 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852619 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852622 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852625 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852627 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852630 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852632 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852635 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852638 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852640 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852643 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852645 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852649 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852651 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852654 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852657 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 20:02:59.857000 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852659 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852662 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852664 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852667 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852669 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852672 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852674 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852677 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852679 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852681 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852684 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852686 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852689 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852691 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852694 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852697 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852700 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852702 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852705 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852708 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 20:02:59.857850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852711 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852713 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852716 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852718 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852722 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852724 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852727 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852729 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852732 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852734 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852737 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852739 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852741 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.852746 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852872 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 20:02:59.858698 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852877 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852880 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852883 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852885 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852888 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852890 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852893 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852895 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852898 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852900 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852903 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852907 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852910 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852912 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852915 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852918 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852920 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852923 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852926 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 20:02:59.859115 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852931 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852934 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852937 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852941 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852944 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852946 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852949 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852951 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852954 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852957 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852960 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852962 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852965 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852969 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852972 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852974 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852977 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852980 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852983 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852987 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 20:02:59.859634 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852989 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852992 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852995 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.852997 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853000 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853003 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853006 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853008 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853011 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853013 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853016 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853018 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853020 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853023 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853025 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853028 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853030 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853033 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853036 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 20:02:59.860299 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853038 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853041 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853043 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853046 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853049 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853051 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853053 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853056 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853058 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853061 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853063 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853066 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853069 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853071 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853074 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853076 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853079 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853081 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853084 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853087 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 20:02:59.860869 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853090 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853092 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853096 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853099 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853101 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853104 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853106 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853109 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853112 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853114 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853117 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853120 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853122 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853124 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853127 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853130 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853132 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853135 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853137 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 20:02:59.861735 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:02:59.853140 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 20:02:59.862290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.853145 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 20:02:59.862290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.853276 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 20:02:59.862290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.855864 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 20:02:59.862290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.857258 2583 server.go:1019] "Starting client certificate rotation" Jul 09 20:02:59.862290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.857387 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 20:02:59.862290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.857511 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 20:02:59.862290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.861079 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 20:02:59.862559 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.862481 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 20:02:59.873727 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.873704 2583 log.go:25] "Validated CRI v1 runtime API" Jul 09 20:02:59.876035 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.876019 2583 log.go:25] "Validated CRI v1 image API" Jul 09 20:02:59.877913 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.877890 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 20:02:59.880539 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.880518 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9a6140d6-c1cb-4d3d-8fed-55d767336c95:/dev/nvme0n1p3 a22ffadd-db59-4bb6-b9d3-aa4bc12b2913:/dev/nvme0n1p4] Jul 09 20:02:59.880611 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.880538 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 20:02:59.886856 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.886719 2583 manager.go:216] Machine: {Timestamp:2026-07-09 20:02:59.885255362 +0000 UTC m=+0.342392593 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094144 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b70324a22276dabc15b61902ee8cc SystemUUID:ec2b7032-4a22-276d-abc1-5b61902ee8cc BootID:36c080c4-9edb-41bc-8591-fd571e8e0465 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a8:0d:03:ce:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a8:0d:03:ce:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:85:f9:1f:17:9a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 20:02:59.886856 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.886837 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 20:02:59.887010 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.886931 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 20:02:59.888892 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.888871 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 20:02:59.888970 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.888879 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 20:02:59.889066 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.888910 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 20:02:59.890162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.890149 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 20:02:59.890210 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.890165 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 20:02:59.890210 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.890173 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 20:02:59.891072 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.891059 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 20:02:59.892357 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.892346 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 20:02:59.895012 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.894999 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 09 20:02:59.895138 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.895128 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 20:02:59.895170 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.895159 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 09 20:02:59.895197 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.895170 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 20:02:59.895197 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.895189 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 20:02:59.895255 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.895198 2583 kubelet.go:398] "Adding apiserver pod source" Jul 09 20:02:59.895255 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.895208 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 20:02:59.895564 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.895553 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 20:02:59.895619 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.895574 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 20:02:59.897894 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.897875 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 20:02:59.899882 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.899868 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 20:02:59.899933 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.899899 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 20:02:59.900090 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.900077 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 20:02:59.900120 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.900099 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 20:02:59.900120 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.900107 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 20:02:59.900120 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.900113 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 20:02:59.900198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.900122 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 20:02:59.900198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.900128 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 20:02:59.901129 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.901119 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 20:02:59.901162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.901130 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 20:02:59.901162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.901137 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 20:02:59.901162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.901142 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 20:02:59.901162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.901151 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 20:02:59.901162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.901160 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 20:02:59.901736 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.901725 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 20:02:59.901736 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.901735 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 20:02:59.905313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.905297 2583 server.go:1268] "Started kubelet" Jul 09 20:02:59.905489 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.905404 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 20:02:59.905735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.905402 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 20:02:59.905735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.905625 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 20:02:59.906420 ip-10-0-142-249 systemd[1]: Started Kubernetes Kubelet. Jul 09 20:02:59.907171 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.907038 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 09 20:02:59.907576 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.907479 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 20:02:59.907576 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.907506 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 20:02:59.907576 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.907546 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 20:02:59.907735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.907607 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 20:02:59.911538 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.911510 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 20:02:59.913852 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.912847 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c0b7a6e6ea05b1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-09 20:02:59.905267121 +0000 UTC m=+0.362404353,LastTimestamp:2026-07-09 20:02:59.905267121 +0000 UTC m=+0.362404353,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}" Jul 09 20:02:59.914960 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.914937 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 20:02:59.915733 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.915709 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 20:02:59.915942 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.915919 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:02:59.916417 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.916400 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 20:02:59.916529 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.916520 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 20:02:59.916607 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.916405 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 20:02:59.916607 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.916562 2583 factory.go:55] Registering systemd factory Jul 09 20:02:59.916721 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.916626 2583 factory.go:223] Registration of the systemd container factory successfully Jul 09 20:02:59.916873 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.916806 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 09 20:02:59.917029 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.916894 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 09 20:02:59.917029 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.917024 2583 factory.go:153] Registering CRI-O factory Jul 09 20:02:59.917124 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.917039 2583 factory.go:223] Registration of the crio container factory successfully Jul 09 20:02:59.917124 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.917090 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 20:02:59.917124 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.917116 2583 factory.go:103] Registering Raw factory Jul 09 20:02:59.917259 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.917129 2583 manager.go:1196] Started watching for new ooms in manager Jul 09 20:02:59.917634 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.917504 2583 manager.go:349] Starting recovery of all containers Jul 09 20:02:59.921718 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.921684 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 20:02:59.921718 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.921707 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 20:02:59.928854 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.928836 2583 manager.go:354] Recovery completed Jul 09 20:02:59.933162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.933130 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kwqjt" Jul 09 20:02:59.933792 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.933772 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 20:02:59.935897 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.935873 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory" Jul 09 20:02:59.935989 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.935923 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 20:02:59.935989 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.935942 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID" Jul 09 20:02:59.936518 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.936500 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 20:02:59.936518 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.936519 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 20:02:59.936664 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.936540 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 09 20:02:59.936664 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.936505 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 20:02:59.937332 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.937315 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory" Jul 09 20:02:59.937418 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.937345 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 20:02:59.937418 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.937355 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID" Jul 09 20:02:59.937680 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.937668 2583 policy_none.go:49] "None policy: Start" Jul 09 20:02:59.937720 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.937690 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 20:02:59.937720 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.937707 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 20:02:59.938203 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.938130 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c0b7a6e8bd767b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-249.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-09 20:02:59.935901307 +0000 UTC m=+0.393038542,LastTimestamp:2026-07-09 20:02:59.935901307 +0000 UTC m=+0.393038542,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}" Jul 09 20:02:59.938751 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.938740 2583 policy_none.go:47] "Start" Jul 09 20:02:59.939758 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.939743 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kwqjt" Jul 09 20:02:59.973086 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.973067 2583 manager.go:337] "Starting Device Plugin manager" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.973109 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.973122 2583 server.go:87] "Starting device plugin registration server" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.973407 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.973420 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.973506 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.973599 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:02:59.973614 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.974199 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 20:02:59.983571 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:02:59.974268 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.073973 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.073937 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 20:03:00.075828 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.075806 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory" Jul 09 20:03:00.075945 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.075846 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 20:03:00.075945 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.075867 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID" Jul 09 20:03:00.075945 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.075900 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.087790 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.087712 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 20:03:00.087956 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.087943 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.088013 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.087965 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-249.ec2.internal\": node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.089118 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.089104 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 20:03:00.089172 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.089138 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 20:03:00.089172 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.089165 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 20:03:00.089242 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.089199 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 20:03:00.091471 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.091436 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 20:03:00.129470 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.129425 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.189609 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.189564 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"] Jul 09 20:03:00.189706 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.189667 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 20:03:00.191321 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.191304 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory" Jul 09 20:03:00.191402 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.191338 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 20:03:00.191402 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.191351 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID" Jul 09 20:03:00.192563 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.192549 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 20:03:00.192683 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.192670 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.192717 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.192700 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 20:03:00.193380 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.193365 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory" Jul 09 20:03:00.193462 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.193400 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 20:03:00.193462 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.193415 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID" Jul 09 20:03:00.193576 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.193400 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory" Jul 09 20:03:00.193576 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.193498 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 20:03:00.193576 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.193509 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID" Jul 09 20:03:00.194732 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.194717 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.194778 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.194744 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 20:03:00.195621 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.195601 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory" Jul 09 20:03:00.195740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.195633 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 20:03:00.195740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.195648 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID" Jul 09 20:03:00.214141 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.214116 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-249.ec2.internal\" not found" node="ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.218755 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.218736 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2908882a0397afa97d2c189b3c05786f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"2908882a0397afa97d2c189b3c05786f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.218854 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.218763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2908882a0397afa97d2c189b3c05786f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"2908882a0397afa97d2c189b3c05786f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.218854 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.218786 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4539760177c018eb2482b2e095c48863-config\") pod \"kube-apiserver-proxy-ip-10-0-142-249.ec2.internal\" (UID: \"4539760177c018eb2482b2e095c48863\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.218964 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.218948 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-249.ec2.internal\" not found" node="ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.229988 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.229963 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.319320 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.319286 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2908882a0397afa97d2c189b3c05786f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"2908882a0397afa97d2c189b3c05786f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.319320 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.319320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2908882a0397afa97d2c189b3c05786f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"2908882a0397afa97d2c189b3c05786f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.319521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.319338 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4539760177c018eb2482b2e095c48863-config\") pod \"kube-apiserver-proxy-ip-10-0-142-249.ec2.internal\" (UID: \"4539760177c018eb2482b2e095c48863\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.319521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.319381 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4539760177c018eb2482b2e095c48863-config\") pod \"kube-apiserver-proxy-ip-10-0-142-249.ec2.internal\" (UID: \"4539760177c018eb2482b2e095c48863\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.319521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.319386 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2908882a0397afa97d2c189b3c05786f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"2908882a0397afa97d2c189b3c05786f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.319521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.319407 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2908882a0397afa97d2c189b3c05786f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"2908882a0397afa97d2c189b3c05786f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.330412 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.330378 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.431285 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.431213 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.516511 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.516476 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.521754 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.521736 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" Jul 09 20:03:00.531470 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.531429 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.632015 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.631970 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.732626 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.732558 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.833131 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.833086 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.856225 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.856197 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 20:03:00.856380 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.856350 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 20:03:00.933290 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:00.933261 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:00.943347 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.943318 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 19:58:00 +0000 UTC" deadline="2028-04-19 00:14:20.231404706 +0000 UTC" Jul 09 20:03:00.943347 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:00.943343 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15580h11m19.288064289s" Jul 09 20:03:01.033616 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:01.033519 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:01.096969 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.096943 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 20:03:01.133680 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:01.133650 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:01.148550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.148530 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 20:03:01.234207 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:01.234169 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:01.242270 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:01.242237 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2908882a0397afa97d2c189b3c05786f.slice/crio-f58cd60bb98c51c3b7506d5e0cdb4eb431006575ad0c2011d0dd60c29c30ea3b WatchSource:0}: Error finding container f58cd60bb98c51c3b7506d5e0cdb4eb431006575ad0c2011d0dd60c29c30ea3b: Status 404 returned error can't find the container with id f58cd60bb98c51c3b7506d5e0cdb4eb431006575ad0c2011d0dd60c29c30ea3b Jul 09 20:03:01.242525 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:01.242507 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4539760177c018eb2482b2e095c48863.slice/crio-0bbbe9741dac348ed1a73d79f39c68a58aa171561f25b9225ff73588d6ae6627 WatchSource:0}: Error finding container 0bbbe9741dac348ed1a73d79f39c68a58aa171561f25b9225ff73588d6ae6627: Status 404 returned error can't find the container with id 0bbbe9741dac348ed1a73d79f39c68a58aa171561f25b9225ff73588d6ae6627 Jul 09 20:03:01.249283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.249266 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 20:03:01.334576 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:01.334462 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:01.435008 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:01.434960 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found" Jul 09 20:03:01.475973 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.475952 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 20:03:01.516664 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.516620 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" Jul 09 20:03:01.555317 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.555284 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 20:03:01.556407 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.556391 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" Jul 09 20:03:01.572929 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.572904 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 20:03:01.858769 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.858731 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 20:03:01.897842 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.897803 2583 apiserver.go:52] "Watching apiserver" Jul 09 20:03:01.913379 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.913334 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 20:03:01.913823 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.913796 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal","openshift-multus/multus-6k9c4","openshift-ovn-kubernetes/ovnkube-node-gjzpj","kube-system/global-pull-secret-syncer-8hmwh","kube-system/konnectivity-agent-6zcck","kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal","openshift-multus/multus-additional-cni-plugins-jkcx6","openshift-multus/network-metrics-daemon-k9bkk","openshift-network-diagnostics/network-check-target-x9whf","openshift-network-operator/iptables-alerter-p5g62","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8","openshift-cluster-node-tuning-operator/tuned-b6lkq","openshift-dns/node-resolver-6mhh5","openshift-image-registry/node-ca-qtcr8"] Jul 09 20:03:01.915317 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.915287 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.916322 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.915706 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 20:03:01.916686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.916664 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:01.918078 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.918057 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.919304 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.919277 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:01.919389 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:01.919357 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:01.919601 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.919580 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bgxxg\"" Jul 09 20:03:01.919690 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.919610 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 20:03:01.919860 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.919830 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 20:03:01.919943 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.919921 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 20:03:01.920058 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.920042 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 20:03:01.920096 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.920083 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 20:03:01.920146 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.920086 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 20:03:01.920467 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.920445 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8d7mv\"" Jul 09 20:03:01.920823 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.920796 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 20:03:01.921630 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.921107 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:01.921630 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.921262 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 20:03:01.921630 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.921282 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 20:03:01.921630 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.921459 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 20:03:01.923062 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.922441 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:01.923062 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.922516 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 20:03:01.923062 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.922451 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 20:03:01.923268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.923200 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 20:03:01.923362 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.923340 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4kk25\"" Jul 09 20:03:01.923889 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.923867 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 20:03:01.924369 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.924345 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:01.924490 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:01.924449 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:01.924905 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.924884 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 20:03:01.925117 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.925097 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w2jfv\"" Jul 09 20:03:01.925377 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.925353 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 20:03:01.925508 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.925408 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 20:03:01.925508 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.925428 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 20:03:01.925690 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.925667 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-755w5\"" Jul 09 20:03:01.925793 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.925779 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:01.925877 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:01.925834 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:01.926880 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.926859 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6k9c4" Jul 09 20:03:01.927910 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.927875 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxg2b\" (UniqueName: \"kubernetes.io/projected/af01d5f8-ca96-44ab-bc22-20cd38611e55-kube-api-access-vxg2b\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:01.928001 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.927920 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-systemd-units\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928001 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.927951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-etc-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928001 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.927981 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928003 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af01d5f8-ca96-44ab-bc22-20cd38611e55-tmp-dir\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:01.928154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928025 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7250d077-6ea3-4eba-b703-558f2ceffe18-ovn-node-metrics-cert\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.928154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-node-log\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-log-socket\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928152 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-ovnkube-config\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928177 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-systemd\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928206 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-var-lib-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928222 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7t7\" (UniqueName: \"kubernetes.io/projected/7250d077-6ea3-4eba-b703-558f2ceffe18-kube-api-access-6s7t7\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928243 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-cni-bin\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928266 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-system-cni-dir\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928308 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-cnibin\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928361 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.928463 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928420 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af01d5f8-ca96-44ab-bc22-20cd38611e55-hosts-file\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-kubelet\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928516 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928541 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-cni-netd\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928578 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-env-overrides\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928605 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-ovnkube-script-lib\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928630 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928659 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtp7\" (UniqueName: \"kubernetes.io/projected/c508b8a3-2f43-4f0c-841f-e766037c4858-kube-api-access-txtp7\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928685 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-slash\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928712 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-ovn\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-os-release\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:01.928957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.928790 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-run-netns\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:01.930402 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.929679 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xpxsp\"" Jul 09 20:03:01.930402 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.929788 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 20:03:01.930402 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.929794 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 20:03:01.930402 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.930059 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:01.931429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.931405 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:01.932698 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.932678 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 20:03:01.932983 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.932967 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5f9xc\"" Jul 09 20:03:01.933063 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.933009 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:01.933063 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.933018 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 20:03:01.933173 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.933112 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 20:03:01.935086 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.934717 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 20:03:01.935332 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.935311 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5k92c\"" Jul 09 20:03:01.936134 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.936104 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 20:03:01.936688 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.936653 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 20:03:01.939187 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.939164 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 20:03:01.939302 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.939203 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvvz5\"" Jul 09 20:03:01.939550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.939416 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 20:03:01.959154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.959117 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gcwk" Jul 09 20:03:01.968419 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:01.968388 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gcwk" Jul 09 20:03:02.018115 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.018084 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 20:03:02.029894 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.029855 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af01d5f8-ca96-44ab-bc22-20cd38611e55-hosts-file\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:02.030141 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.029900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030141 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.029958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-env-overrides\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030141 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030000 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysctl-d\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.030141 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030004 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030141 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030028 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8af453f9-156b-40dc-9325-e4289f5b1920-tmp\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.030141 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030053 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af01d5f8-ca96-44ab-bc22-20cd38611e55-hosts-file\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:02.030141 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030066 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvq9\" (UniqueName: \"kubernetes.io/projected/1367c363-01b3-4c1e-bc94-5e8bd1afef16-kube-api-access-gdvq9\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:02.030141 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-multus-certs\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030156 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030184 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtp7\" (UniqueName: \"kubernetes.io/projected/c508b8a3-2f43-4f0c-841f-e766037c4858-kube-api-access-txtp7\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030208 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-slash\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030226 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-ovn\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030252 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-dbus\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mtnq\" (UniqueName: \"kubernetes.io/projected/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-kube-api-access-6mtnq\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030324 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-ovn\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030330 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-cni-bin\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030358 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-run-netns\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030382 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-run\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030397 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030411 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-kubelet-config\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030436 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030500 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxg2b\" (UniqueName: \"kubernetes.io/projected/af01d5f8-ca96-44ab-bc22-20cd38611e55-kube-api-access-vxg2b\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030526 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-run-netns\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.030602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030532 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-k8s-cni-cncf-io\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030560 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-kubelet\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-etc-kubernetes\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030612 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4lqk\" (UniqueName: \"kubernetes.io/projected/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-kube-api-access-x4lqk\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af01d5f8-ca96-44ab-bc22-20cd38611e55-tmp-dir\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030663 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-env-overrides\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030670 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7250d077-6ea3-4eba-b703-558f2ceffe18-ovn-node-metrics-cert\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030701 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030727 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-cnibin\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030754 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c94deb57-ac1f-4104-b8ce-bc82433a8875-iptables-alerter-script\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030780 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030809 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8af453f9-156b-40dc-9325-e4289f5b1920-etc-tuned\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030835 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-netns\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-host\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030907 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lg7k\" (UniqueName: \"kubernetes.io/projected/8af453f9-156b-40dc-9325-e4289f5b1920-kube-api-access-8lg7k\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030919 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af01d5f8-ca96-44ab-bc22-20cd38611e55-tmp-dir\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-socket-dir-parent\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.031456 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030951 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030958 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-socket-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.030986 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6kft\" (UniqueName: \"kubernetes.io/projected/fab34251-bd61-41e7-a20c-d0b7b310efa9-kube-api-access-z6kft\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031013 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-system-cni-dir\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-cnibin\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031118 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031144 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-var-lib-kubelet\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031153 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031171 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-cni-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031196 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-cni-multus\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031223 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-kubelet\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031247 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-cni-netd\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-ovnkube-script-lib\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031310 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-modprobe-d\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031357 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c94deb57-ac1f-4104-b8ce-bc82433a8875-host-slash\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031343 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-system-cni-dir\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031384 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-device-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.032310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031410 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031465 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-cnibin\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031494 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031544 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-system-cni-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031591 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-os-release\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031634 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysctl-conf\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031660 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ff28489-1fdf-459c-9276-e419e8dfaeab-konnectivity-ca\") pod \"konnectivity-agent-6zcck\" (UID: \"9ff28489-1fdf-459c-9276-e419e8dfaeab\") " pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031703 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-cni-binary-copy\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031742 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-systemd-units\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031786 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-etc-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031813 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031867 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-kubernetes\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031895 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-systemd\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031923 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-sys\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031950 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-os-release\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.031974 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ff28489-1fdf-459c-9276-e419e8dfaeab-agent-certs\") pod \"konnectivity-agent-6zcck\" (UID: \"9ff28489-1fdf-459c-9276-e419e8dfaeab\") " pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032003 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:02.033119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032047 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-hostroot\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032049 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-ovnkube-script-lib\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032057 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c508b8a3-2f43-4f0c-841f-e766037c4858-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032071 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-conf-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032098 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txrmp\" (UniqueName: \"kubernetes.io/projected/c94deb57-ac1f-4104-b8ce-bc82433a8875-kube-api-access-txrmp\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032108 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-systemd-units\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032119 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-cni-netd\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032157 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-kubelet\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032167 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-etc-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032183 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032199 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-node-log\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032228 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-log-socket\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032232 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-os-release\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032264 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-log-socket\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032276 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-ovnkube-config\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032309 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-lib-modules\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032337 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-node-log\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.033740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032382 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-serviceca\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-daemon-config\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032475 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-systemd\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032509 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-var-lib-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7t7\" (UniqueName: \"kubernetes.io/projected/7250d077-6ea3-4eba-b703-558f2ceffe18-kube-api-access-6s7t7\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032578 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysconfig\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032590 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-run-systemd\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032624 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-host\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032643 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-var-lib-openvswitch\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032689 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-registration-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032704 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7250d077-6ea3-4eba-b703-558f2ceffe18-ovnkube-config\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032752 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-cni-bin\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032766 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-cni-bin\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032780 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-sys-fs\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032891 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.032970 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7250d077-6ea3-4eba-b703-558f2ceffe18-host-slash\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.034358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.033093 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c508b8a3-2f43-4f0c-841f-e766037c4858-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.035014 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.034902 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7250d077-6ea3-4eba-b703-558f2ceffe18-ovn-node-metrics-cert\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.040431 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.040395 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxg2b\" (UniqueName: \"kubernetes.io/projected/af01d5f8-ca96-44ab-bc22-20cd38611e55-kube-api-access-vxg2b\") pod \"node-resolver-6mhh5\" (UID: \"af01d5f8-ca96-44ab-bc22-20cd38611e55\") " pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:02.040768 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.040716 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7t7\" (UniqueName: \"kubernetes.io/projected/7250d077-6ea3-4eba-b703-558f2ceffe18-kube-api-access-6s7t7\") pod \"ovnkube-node-gjzpj\" (UID: \"7250d077-6ea3-4eba-b703-558f2ceffe18\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.041166 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.041138 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtp7\" (UniqueName: \"kubernetes.io/projected/c508b8a3-2f43-4f0c-841f-e766037c4858-kube-api-access-txtp7\") pod \"multus-additional-cni-plugins-jkcx6\" (UID: \"c508b8a3-2f43-4f0c-841f-e766037c4858\") " pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.093776 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.093722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" event={"ID":"4539760177c018eb2482b2e095c48863","Type":"ContainerStarted","Data":"0bbbe9741dac348ed1a73d79f39c68a58aa171561f25b9225ff73588d6ae6627"} Jul 09 20:03:02.094863 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.094836 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" event={"ID":"2908882a0397afa97d2c189b3c05786f","Type":"ContainerStarted","Data":"f58cd60bb98c51c3b7506d5e0cdb4eb431006575ad0c2011d0dd60c29c30ea3b"} Jul 09 20:03:02.133269 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysctl-d\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.133269 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8af453f9-156b-40dc-9325-e4289f5b1920-tmp\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.133269 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133233 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvq9\" (UniqueName: \"kubernetes.io/projected/1367c363-01b3-4c1e-bc94-5e8bd1afef16-kube-api-access-gdvq9\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:02.133269 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133254 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-multus-certs\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133273 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-dbus\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133298 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mtnq\" (UniqueName: \"kubernetes.io/projected/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-kube-api-access-6mtnq\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133322 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-cni-bin\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-run\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-kubelet-config\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133382 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-multus-certs\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133388 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysctl-d\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133437 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-cni-bin\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133470 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-kubelet-config\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133478 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-run\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133526 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-k8s-cni-cncf-io\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-dbus\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133555 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-kubelet\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-k8s-cni-cncf-io\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133615 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133624 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-etc-kubernetes\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.133674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133626 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-kubelet\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4lqk\" (UniqueName: \"kubernetes.io/projected/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-kube-api-access-x4lqk\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133694 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133700 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-etc-kubernetes\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-cnibin\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133748 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c94deb57-ac1f-4104-b8ce-bc82433a8875-iptables-alerter-script\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.133797 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133807 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-cnibin\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8af453f9-156b-40dc-9325-e4289f5b1920-etc-tuned\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133852 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-netns\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133884 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-run-netns\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.133886 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:02.633859761 +0000 UTC m=+3.090996981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-host\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.133983 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lg7k\" (UniqueName: \"kubernetes.io/projected/8af453f9-156b-40dc-9325-e4289f5b1920-kube-api-access-8lg7k\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134011 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-socket-dir-parent\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-socket-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134040 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-host\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.134686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134065 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6kft\" (UniqueName: \"kubernetes.io/projected/fab34251-bd61-41e7-a20c-d0b7b310efa9-kube-api-access-z6kft\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134107 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-var-lib-kubelet\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134118 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-socket-dir-parent\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134165 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-cni-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134181 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-var-lib-kubelet\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134206 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-cni-multus\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134240 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-socket-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134240 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-modprobe-d\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134288 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c94deb57-ac1f-4104-b8ce-bc82433a8875-host-slash\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134313 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-cni-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134318 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-device-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134319 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c94deb57-ac1f-4104-b8ce-bc82433a8875-iptables-alerter-script\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134349 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-modprobe-d\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134359 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-device-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134365 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-host-var-lib-cni-multus\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134385 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c94deb57-ac1f-4104-b8ce-bc82433a8875-host-slash\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134394 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.135550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134430 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-system-cni-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134460 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysctl-conf\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134487 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ff28489-1fdf-459c-9276-e419e8dfaeab-konnectivity-ca\") pod \"konnectivity-agent-6zcck\" (UID: \"9ff28489-1fdf-459c-9276-e419e8dfaeab\") " pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134515 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134524 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-system-cni-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-cni-binary-copy\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134645 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysctl-conf\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134680 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-kubernetes\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-systemd\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134735 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-sys\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134753 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-kubernetes\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134759 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-os-release\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134811 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ff28489-1fdf-459c-9276-e419e8dfaeab-agent-certs\") pod \"konnectivity-agent-6zcck\" (UID: \"9ff28489-1fdf-459c-9276-e419e8dfaeab\") " pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134843 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134850 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-systemd\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-hostroot\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134894 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-sys\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134896 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-conf-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134930 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-conf-dir\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134931 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txrmp\" (UniqueName: \"kubernetes.io/projected/c94deb57-ac1f-4104-b8ce-bc82433a8875-kube-api-access-txrmp\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-lib-modules\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-serviceca\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135019 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-daemon-config\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135072 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysconfig\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135096 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-host\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135106 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ff28489-1fdf-459c-9276-e419e8dfaeab-konnectivity-ca\") pod \"konnectivity-agent-6zcck\" (UID: \"9ff28489-1fdf-459c-9276-e419e8dfaeab\") " pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135123 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-registration-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135152 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-sys-fs\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135266 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-sys-fs\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135305 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-cni-binary-copy\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135374 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-host\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135387 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-etc-sysconfig\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8af453f9-156b-40dc-9325-e4289f5b1920-lib-modules\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135579 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-serviceca\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135597 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fab34251-bd61-41e7-a20c-d0b7b310efa9-registration-dir\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.136972 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.135673 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:02.137573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135696 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-hostroot\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.137573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.135725 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-multus-daemon-config\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.137573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.134813 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-os-release\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.137573 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.135749 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret podName:3f591d68-dbcc-4d9c-9dab-cac01af2da3c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:02.63572129 +0000 UTC m=+3.092858522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret") pod "global-pull-secret-syncer-8hmwh" (UID: "3f591d68-dbcc-4d9c-9dab-cac01af2da3c") : object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:02.137573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.136368 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8af453f9-156b-40dc-9325-e4289f5b1920-tmp\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.137573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.136641 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8af453f9-156b-40dc-9325-e4289f5b1920-etc-tuned\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.137893 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.137870 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ff28489-1fdf-459c-9276-e419e8dfaeab-agent-certs\") pod \"konnectivity-agent-6zcck\" (UID: \"9ff28489-1fdf-459c-9276-e419e8dfaeab\") " pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:02.148154 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.147658 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 20:03:02.148154 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.147689 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 20:03:02.148154 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.147704 2583 projected.go:196] Error preparing data for projected volume kube-api-access-lkb5r for pod openshift-network-diagnostics/network-check-target-x9whf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:02.148154 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.147787 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r podName:1548b980-1173-46b0-b92b-92169bd6c64d nodeName:}" failed. No retries permitted until 2026-07-09 20:03:02.647766207 +0000 UTC m=+3.104903427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lkb5r" (UniqueName: "kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r") pod "network-check-target-x9whf" (UID: "1548b980-1173-46b0-b92b-92169bd6c64d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:02.149551 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.149336 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mtnq\" (UniqueName: \"kubernetes.io/projected/1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7-kube-api-access-6mtnq\") pod \"node-ca-qtcr8\" (UID: \"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7\") " pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.149551 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.149455 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4lqk\" (UniqueName: \"kubernetes.io/projected/0b1aafb2-3655-4327-aa7e-6d5aae3a10e8-kube-api-access-x4lqk\") pod \"multus-6k9c4\" (UID: \"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8\") " pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.149818 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.149792 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lg7k\" (UniqueName: \"kubernetes.io/projected/8af453f9-156b-40dc-9325-e4289f5b1920-kube-api-access-8lg7k\") pod \"tuned-b6lkq\" (UID: \"8af453f9-156b-40dc-9325-e4289f5b1920\") " pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.149884 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.149814 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6kft\" (UniqueName: \"kubernetes.io/projected/fab34251-bd61-41e7-a20c-d0b7b310efa9-kube-api-access-z6kft\") pod \"aws-ebs-csi-driver-node-hkjk8\" (UID: \"fab34251-bd61-41e7-a20c-d0b7b310efa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.150086 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.150069 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvq9\" (UniqueName: \"kubernetes.io/projected/1367c363-01b3-4c1e-bc94-5e8bd1afef16-kube-api-access-gdvq9\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:02.150782 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.150756 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txrmp\" (UniqueName: \"kubernetes.io/projected/c94deb57-ac1f-4104-b8ce-bc82433a8875-kube-api-access-txrmp\") pod \"iptables-alerter-p5g62\" (UID: \"c94deb57-ac1f-4104-b8ce-bc82433a8875\") " pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.228737 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.228705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" Jul 09 20:03:02.241798 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.241749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6mhh5" Jul 09 20:03:02.242495 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:02.242396 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc508b8a3_2f43_4f0c_841f_e766037c4858.slice/crio-a09d65e92f8c115db4422e2172dab7ce6aa6141b626b1ef6059ad0d83ae2c3a0 WatchSource:0}: Error finding container a09d65e92f8c115db4422e2172dab7ce6aa6141b626b1ef6059ad0d83ae2c3a0: Status 404 returned error can't find the container with id a09d65e92f8c115db4422e2172dab7ce6aa6141b626b1ef6059ad0d83ae2c3a0 Jul 09 20:03:02.250607 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.250395 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:02.253718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:02.253689 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf01d5f8_ca96_44ab_bc22_20cd38611e55.slice/crio-eacf974ad1351dc1f8f80e6afe6faa456457b8565e493354f1b9030a975cf5d6 WatchSource:0}: Error finding container eacf974ad1351dc1f8f80e6afe6faa456457b8565e493354f1b9030a975cf5d6: Status 404 returned error can't find the container with id eacf974ad1351dc1f8f80e6afe6faa456457b8565e493354f1b9030a975cf5d6 Jul 09 20:03:02.258368 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.258341 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:02.264166 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.264143 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qtcr8" Jul 09 20:03:02.272291 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.272266 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6k9c4" Jul 09 20:03:02.277632 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:02.277596 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5ffb5f_ec68_44fe_9ff2_d48accd74fd7.slice/crio-bc5c76f26178006b176ef6d0e39ff73874510c456b6e498cb7646e83f39c5aef WatchSource:0}: Error finding container bc5c76f26178006b176ef6d0e39ff73874510c456b6e498cb7646e83f39c5aef: Status 404 returned error can't find the container with id bc5c76f26178006b176ef6d0e39ff73874510c456b6e498cb7646e83f39c5aef Jul 09 20:03:02.284440 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.284413 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p5g62" Jul 09 20:03:02.291285 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.291262 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" Jul 09 20:03:02.296580 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.296557 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" Jul 09 20:03:02.297266 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:02.297234 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94deb57_ac1f_4104_b8ce_bc82433a8875.slice/crio-248ec923b663f7796fa4e4ab18544adda114223a4412ca6a365e0f62f531a2ed WatchSource:0}: Error finding container 248ec923b663f7796fa4e4ab18544adda114223a4412ca6a365e0f62f531a2ed: Status 404 returned error can't find the container with id 248ec923b663f7796fa4e4ab18544adda114223a4412ca6a365e0f62f531a2ed Jul 09 20:03:02.307220 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:02.307191 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1aafb2_3655_4327_aa7e_6d5aae3a10e8.slice/crio-e01ed352e5582dad8f9ccbc4649ef5c771bcd2d811ef1c872119138a71b8965f WatchSource:0}: Error finding container e01ed352e5582dad8f9ccbc4649ef5c771bcd2d811ef1c872119138a71b8965f: Status 404 returned error can't find the container with id e01ed352e5582dad8f9ccbc4649ef5c771bcd2d811ef1c872119138a71b8965f Jul 09 20:03:02.311846 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:02.311806 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af453f9_156b_40dc_9325_e4289f5b1920.slice/crio-fba695bc5f5c1c204c820b8a74ee117d013057ed5f765896b61484d3406fdbc8 WatchSource:0}: Error finding container fba695bc5f5c1c204c820b8a74ee117d013057ed5f765896b61484d3406fdbc8: Status 404 returned error can't find the container with id fba695bc5f5c1c204c820b8a74ee117d013057ed5f765896b61484d3406fdbc8 Jul 09 20:03:02.315111 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:02.314682 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab34251_bd61_41e7_a20c_d0b7b310efa9.slice/crio-aac1b576864f4e712fa5ce4116ed7b264f762638722594f42e9ac76a2cc69966 WatchSource:0}: Error finding container aac1b576864f4e712fa5ce4116ed7b264f762638722594f42e9ac76a2cc69966: Status 404 returned error can't find the container with id aac1b576864f4e712fa5ce4116ed7b264f762638722594f42e9ac76a2cc69966 Jul 09 20:03:02.639973 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.639932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:02.640135 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.640033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:02.640135 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.640085 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:02.640292 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.640144 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:02.640292 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.640161 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:03.640145378 +0000 UTC m=+4.097282597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:02.640292 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.640197 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret podName:3f591d68-dbcc-4d9c-9dab-cac01af2da3c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:03.640181447 +0000 UTC m=+4.097318670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret") pod "global-pull-secret-syncer-8hmwh" (UID: "3f591d68-dbcc-4d9c-9dab-cac01af2da3c") : object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:02.741042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.741005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:02.741234 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.741210 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 20:03:02.741307 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.741239 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 20:03:02.741307 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.741256 2583 projected.go:196] Error preparing data for projected volume kube-api-access-lkb5r for pod openshift-network-diagnostics/network-check-target-x9whf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:02.741403 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:02.741333 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r podName:1548b980-1173-46b0-b92b-92169bd6c64d nodeName:}" failed. No retries permitted until 2026-07-09 20:03:03.741310888 +0000 UTC m=+4.198448116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkb5r" (UniqueName: "kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r") pod "network-check-target-x9whf" (UID: "1548b980-1173-46b0-b92b-92169bd6c64d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:02.971087 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.970986 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 19:58:02 +0000 UTC" deadline="2028-04-15 15:43:35.0561773 +0000 UTC" Jul 09 20:03:02.971087 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:02.971022 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15499h40m32.085160304s" Jul 09 20:03:03.089437 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.089397 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:03.089623 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.089409 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:03.089623 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.089596 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:03.089768 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.089741 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:03.103976 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.103927 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" event={"ID":"fab34251-bd61-41e7-a20c-d0b7b310efa9","Type":"ContainerStarted","Data":"aac1b576864f4e712fa5ce4116ed7b264f762638722594f42e9ac76a2cc69966"} Jul 09 20:03:03.106094 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.106038 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p5g62" event={"ID":"c94deb57-ac1f-4104-b8ce-bc82433a8875","Type":"ContainerStarted","Data":"248ec923b663f7796fa4e4ab18544adda114223a4412ca6a365e0f62f531a2ed"} Jul 09 20:03:03.109647 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.109596 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qtcr8" event={"ID":"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7","Type":"ContainerStarted","Data":"bc5c76f26178006b176ef6d0e39ff73874510c456b6e498cb7646e83f39c5aef"} Jul 09 20:03:03.111574 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.111549 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"19ebb35f1413451a0fbc06f7ddac63ed427a7a0662cb040b63a16f0a19c51eb8"} Jul 09 20:03:03.114223 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.114198 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6mhh5" event={"ID":"af01d5f8-ca96-44ab-bc22-20cd38611e55","Type":"ContainerStarted","Data":"eacf974ad1351dc1f8f80e6afe6faa456457b8565e493354f1b9030a975cf5d6"} Jul 09 20:03:03.115789 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.115749 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" event={"ID":"8af453f9-156b-40dc-9325-e4289f5b1920","Type":"ContainerStarted","Data":"fba695bc5f5c1c204c820b8a74ee117d013057ed5f765896b61484d3406fdbc8"} Jul 09 20:03:03.117899 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.117871 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6k9c4" event={"ID":"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8","Type":"ContainerStarted","Data":"e01ed352e5582dad8f9ccbc4649ef5c771bcd2d811ef1c872119138a71b8965f"} Jul 09 20:03:03.119223 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.119197 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6zcck" event={"ID":"9ff28489-1fdf-459c-9276-e419e8dfaeab","Type":"ContainerStarted","Data":"44ad66ed3eb1ce9dcb3abf94a4f93856cbd6c74602732b51eca43bcac74d43d5"} Jul 09 20:03:03.120871 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.120845 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" event={"ID":"c508b8a3-2f43-4f0c-841f-e766037c4858","Type":"ContainerStarted","Data":"a09d65e92f8c115db4422e2172dab7ce6aa6141b626b1ef6059ad0d83ae2c3a0"} Jul 09 20:03:03.650247 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.649926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:03.650247 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.650220 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:03.650247 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.650225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:03.650613 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.650303 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret podName:3f591d68-dbcc-4d9c-9dab-cac01af2da3c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:05.650282445 +0000 UTC m=+6.107419668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret") pod "global-pull-secret-syncer-8hmwh" (UID: "3f591d68-dbcc-4d9c-9dab-cac01af2da3c") : object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:03.650613 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.650354 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:03.650613 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.650412 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:05.650394369 +0000 UTC m=+6.107531590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:03.751822 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.751780 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:03.752081 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.752049 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 20:03:03.752167 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.752089 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 20:03:03.752167 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.752105 2583 projected.go:196] Error preparing data for projected volume kube-api-access-lkb5r for pod openshift-network-diagnostics/network-check-target-x9whf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:03.752281 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:03.752174 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r podName:1548b980-1173-46b0-b92b-92169bd6c64d nodeName:}" failed. No retries permitted until 2026-07-09 20:03:05.752154165 +0000 UTC m=+6.209291390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkb5r" (UniqueName: "kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r") pod "network-check-target-x9whf" (UID: "1548b980-1173-46b0-b92b-92169bd6c64d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:03.971750 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.971593 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 19:58:02 +0000 UTC" deadline="2028-04-20 01:47:49.418195776 +0000 UTC" Jul 09 20:03:03.971750 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:03.971691 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15605h44m45.446510026s" Jul 09 20:03:04.095588 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:04.094702 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:04.095588 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:04.094947 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:05.089429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:05.089382 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:05.089980 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.089571 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:05.090061 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:05.090019 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:05.090141 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.090119 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:05.672260 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:05.672157 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:05.672260 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:05.672228 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:05.672584 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.672375 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:05.672584 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.672446 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:09.672424101 +0000 UTC m=+10.129561329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:05.672943 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.672898 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:05.673043 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.672959 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret podName:3f591d68-dbcc-4d9c-9dab-cac01af2da3c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:09.6729423 +0000 UTC m=+10.130079525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret") pod "global-pull-secret-syncer-8hmwh" (UID: "3f591d68-dbcc-4d9c-9dab-cac01af2da3c") : object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:05.774309 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:05.773626 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:05.774309 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.773841 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 20:03:05.774309 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.773860 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 20:03:05.774309 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.773874 2583 projected.go:196] Error preparing data for projected volume kube-api-access-lkb5r for pod openshift-network-diagnostics/network-check-target-x9whf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:05.774309 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:05.773935 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r podName:1548b980-1173-46b0-b92b-92169bd6c64d nodeName:}" failed. No retries permitted until 2026-07-09 20:03:09.773916142 +0000 UTC m=+10.231053373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkb5r" (UniqueName: "kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r") pod "network-check-target-x9whf" (UID: "1548b980-1173-46b0-b92b-92169bd6c64d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:06.090500 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:06.090447 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:06.091022 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:06.090609 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:07.090460 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:07.089722 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:07.090460 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:07.089884 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:07.090460 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:07.090305 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:07.090460 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:07.090405 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:08.090503 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:08.090447 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:08.090758 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:08.090618 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:09.090000 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:09.089912 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:09.090173 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.090038 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:09.090173 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:09.090117 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:09.090305 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.090183 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:09.709884 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:09.709842 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:09.710368 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:09.709896 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:09.710368 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.710016 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:09.710368 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.710029 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:09.710368 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.710120 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret podName:3f591d68-dbcc-4d9c-9dab-cac01af2da3c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:17.710097485 +0000 UTC m=+18.167234723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret") pod "global-pull-secret-syncer-8hmwh" (UID: "3f591d68-dbcc-4d9c-9dab-cac01af2da3c") : object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:09.710368 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.710144 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:17.710132156 +0000 UTC m=+18.167269380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:09.810302 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:09.810260 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:09.810515 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.810475 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 20:03:09.810515 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.810515 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 20:03:09.810614 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.810530 2583 projected.go:196] Error preparing data for projected volume kube-api-access-lkb5r for pod openshift-network-diagnostics/network-check-target-x9whf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:09.810614 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:09.810597 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r podName:1548b980-1173-46b0-b92b-92169bd6c64d nodeName:}" failed. No retries permitted until 2026-07-09 20:03:17.810577897 +0000 UTC m=+18.267715147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkb5r" (UniqueName: "kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r") pod "network-check-target-x9whf" (UID: "1548b980-1173-46b0-b92b-92169bd6c64d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:10.094095 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:10.094003 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:10.094275 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:10.094147 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:11.090284 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:11.090243 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:11.090823 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:11.090243 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:11.090823 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:11.090379 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:11.090823 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:11.090445 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:12.090967 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:12.090434 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:12.090967 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:12.090578 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:13.090020 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:13.089979 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:13.090266 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:13.090040 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:13.090266 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:13.090174 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:13.090567 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:13.090450 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:14.093620 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:14.093584 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:14.094054 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:14.093719 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:15.090226 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:15.090189 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:15.090420 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:15.090189 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:15.090420 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:15.090337 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:15.090420 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:15.090396 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:16.089952 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:16.089915 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:16.090441 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:16.090036 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:17.090130 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:17.090086 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:17.090634 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.090244 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:17.090699 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:17.090657 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:17.090785 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.090755 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:17.771182 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:17.771148 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:17.771378 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:17.771224 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:17.771378 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.771321 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:17.771378 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.771321 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:17.771544 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.771392 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret podName:3f591d68-dbcc-4d9c-9dab-cac01af2da3c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:33.771370303 +0000 UTC m=+34.228507536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret") pod "global-pull-secret-syncer-8hmwh" (UID: "3f591d68-dbcc-4d9c-9dab-cac01af2da3c") : object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:17.771544 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.771411 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:33.771401645 +0000 UTC m=+34.228538869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:17.872406 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:17.872358 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:17.872591 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.872562 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 20:03:17.872632 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.872592 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 20:03:17.872632 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.872605 2583 projected.go:196] Error preparing data for projected volume kube-api-access-lkb5r for pod openshift-network-diagnostics/network-check-target-x9whf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:17.872712 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:17.872663 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r podName:1548b980-1173-46b0-b92b-92169bd6c64d nodeName:}" failed. No retries permitted until 2026-07-09 20:03:33.872645764 +0000 UTC m=+34.329782986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkb5r" (UniqueName: "kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r") pod "network-check-target-x9whf" (UID: "1548b980-1173-46b0-b92b-92169bd6c64d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:18.090245 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:18.090165 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:18.090695 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:18.090303 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:19.089877 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:19.089841 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:19.090025 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:19.089858 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:19.090025 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:19.089976 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:19.090025 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:19.090013 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:20.090307 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:20.090267 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:20.090801 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:20.090396 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:21.090130 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:21.090099 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:21.090314 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:21.090098 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:21.090314 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:21.090241 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:21.090778 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:21.090320 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:22.090028 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:22.089990 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:22.090310 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:22.090129 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:23.089721 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.089549 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:23.090027 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.089549 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:23.090027 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:23.089815 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:23.090027 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:23.089915 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:23.177484 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.177406 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" event={"ID":"8af453f9-156b-40dc-9325-e4289f5b1920","Type":"ContainerStarted","Data":"79d3dc4175aacf5c5f98e42f4a72195ea39382880f7dd1fc8267aff376a80485"} Jul 09 20:03:23.185248 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.181950 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6k9c4" event={"ID":"0b1aafb2-3655-4327-aa7e-6d5aae3a10e8","Type":"ContainerStarted","Data":"fd011dd35073090553791ac4f527f49bfa1d451ef4bb3ef77061dbbd4649e880"} Jul 09 20:03:23.185248 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.184567 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" event={"ID":"4539760177c018eb2482b2e095c48863","Type":"ContainerStarted","Data":"8fd3ca6fb995b5ade05b809d64cde9cf88db5c604076384a2be05fd280389c7c"} Jul 09 20:03:23.188173 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.188150 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:03:23.188551 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.188529 2583 generic.go:356] "Generic (PLEG): container finished" podID="7250d077-6ea3-4eba-b703-558f2ceffe18" containerID="165d61a0fbc1b02d771c07d73bb724f2ee225734844e904302cb149a057c68ff" exitCode=1 Jul 09 20:03:23.188639 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.188564 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"3b63b9d5d21a17166125ed642981f81ba6ebfab7fb089ec8269477251e5fdf23"} Jul 09 20:03:23.188639 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.188615 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerDied","Data":"165d61a0fbc1b02d771c07d73bb724f2ee225734844e904302cb149a057c68ff"} Jul 09 20:03:23.188702 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.188646 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"71b2e84b60fa71c6319a37114375368ecb0965b928862ebd2c0305b4da8e9cbf"} Jul 09 20:03:23.195359 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.194906 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b6lkq" podStartSLOduration=1.679254215 podStartE2EDuration="22.194892679s" totalImagesPullingTime="20.515638464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:23.194703871 +0000 UTC m=+23.651841112" watchObservedRunningTime="2026-07-09 20:03:23.194892679 +0000 UTC m=+23.652029919" Jul 09 20:03:23.238650 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:23.237852 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6k9c4" podStartSLOduration=1.634895045 podStartE2EDuration="22.237828842s" totalImagesPullingTime="20.602933797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:23.215361585 +0000 UTC m=+23.672498853" watchObservedRunningTime="2026-07-09 20:03:23.237828842 +0000 UTC m=+23.694966135" Jul 09 20:03:24.090524 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.090273 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:24.091506 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:24.090638 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:24.192028 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.191999 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" event={"ID":"fab34251-bd61-41e7-a20c-d0b7b310efa9","Type":"ContainerStarted","Data":"d9042b058892a1147ee59130bdd8a982befadd335e778f4fe2b636a4f0568aa2"} Jul 09 20:03:24.193431 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.193411 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p5g62" event={"ID":"c94deb57-ac1f-4104-b8ce-bc82433a8875","Type":"ContainerStarted","Data":"e6bdae380c684b704f8eeb6ee68b6713f127421a2e676fceabf89c7cf58a2799"} Jul 09 20:03:24.194848 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.194824 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qtcr8" event={"ID":"1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7","Type":"ContainerStarted","Data":"04fd948c6ce0e9876a7424b58f548f1f49048261e25e1859d5e0deb7056c332a"} Jul 09 20:03:24.197393 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.197375 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:03:24.197791 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.197773 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"cb00f703200e1f6e46f36875a6f036c0d08c49e7bdcead63e4f807cbf67c6589"} Jul 09 20:03:24.197880 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.197842 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"0d33a54bb5488e044642e161cc5e6a230cc01fa397f4a4a4076c7fb610cbbe9a"} Jul 09 20:03:24.197944 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.197894 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"63c6350451344a7f5e2fbb998e0335006ed8b7978d521aa4e1244d79b5cdfc1b"} Jul 09 20:03:24.199069 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.199051 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6mhh5" event={"ID":"af01d5f8-ca96-44ab-bc22-20cd38611e55","Type":"ContainerStarted","Data":"b50b1102336a0b00fd7c2393fdc0bd5c5e40727a81997de1a9aba9f15b158ae9"} Jul 09 20:03:24.200344 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.200321 2583 generic.go:356] "Generic (PLEG): container finished" podID="2908882a0397afa97d2c189b3c05786f" containerID="828b6af1735c2673cec3c5f98f8eccea4b81a5007a835ea98f4eeb75a85ff7fc" exitCode=0 Jul 09 20:03:24.200422 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.200346 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" event={"ID":"2908882a0397afa97d2c189b3c05786f","Type":"ContainerDied","Data":"828b6af1735c2673cec3c5f98f8eccea4b81a5007a835ea98f4eeb75a85ff7fc"} Jul 09 20:03:24.201868 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.201845 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6zcck" event={"ID":"9ff28489-1fdf-459c-9276-e419e8dfaeab","Type":"ContainerStarted","Data":"4d1583450e80aaeccfde3ae0c9d16d20639a1239182bbf537d344d063764b38d"} Jul 09 20:03:24.203243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.203222 2583 generic.go:356] "Generic (PLEG): container finished" podID="c508b8a3-2f43-4f0c-841f-e766037c4858" containerID="80951f5b3d1a4136197740c6e0b4cdc72caf0254a8befa68cb1350f7572b0f63" exitCode=0 Jul 09 20:03:24.203339 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.203321 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" event={"ID":"c508b8a3-2f43-4f0c-841f-e766037c4858","Type":"ContainerDied","Data":"80951f5b3d1a4136197740c6e0b4cdc72caf0254a8befa68cb1350f7572b0f63"} Jul 09 20:03:24.206362 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.206315 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" podStartSLOduration=22.206300025 podStartE2EDuration="22.206300025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:23.238932904 +0000 UTC m=+23.696070144" watchObservedRunningTime="2026-07-09 20:03:24.206300025 +0000 UTC m=+24.663437267" Jul 09 20:03:24.206560 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.206539 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p5g62" podStartSLOduration=2.678222832 podStartE2EDuration="23.206533784s" totalImagesPullingTime="20.528310952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:24.206435634 +0000 UTC m=+24.663572874" watchObservedRunningTime="2026-07-09 20:03:24.206533784 +0000 UTC m=+24.663671023" Jul 09 20:03:24.220527 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.220425 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6mhh5" podStartSLOduration=2.640280919 podStartE2EDuration="23.220412663s" totalImagesPullingTime="20.580131744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:24.21975598 +0000 UTC m=+24.676893221" watchObservedRunningTime="2026-07-09 20:03:24.220412663 +0000 UTC m=+24.677549903" Jul 09 20:03:24.255368 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.255309 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6zcck" podStartSLOduration=2.685585423 podStartE2EDuration="23.255288871s" totalImagesPullingTime="20.569703448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:24.254955192 +0000 UTC m=+24.712092445" watchObservedRunningTime="2026-07-09 20:03:24.255288871 +0000 UTC m=+24.712426111" Jul 09 20:03:24.289077 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.289016 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qtcr8" podStartSLOduration=2.732309363 podStartE2EDuration="23.288994593s" totalImagesPullingTime="20.55668523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:24.273562522 +0000 UTC m=+24.730699761" watchObservedRunningTime="2026-07-09 20:03:24.288994593 +0000 UTC m=+24.746131894" Jul 09 20:03:24.914178 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.914146 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 20:03:24.991680 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.991582 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T20:03:24.914170594Z","UUID":"33bb0860-e503-4897-a056-43585f8205bf","Handler":null,"Name":"","Endpoint":""} Jul 09 20:03:24.993080 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.993058 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 20:03:24.993198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:24.993099 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 20:03:25.089780 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:25.089692 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:25.089780 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:25.089716 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:25.090025 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:25.089809 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:25.090025 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:25.089867 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:25.208269 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:25.208230 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" event={"ID":"fab34251-bd61-41e7-a20c-d0b7b310efa9","Type":"ContainerStarted","Data":"d3f4c4552429f9c7d015dc7a89064f009e3df646f092352ca449ad6ebd2c4e36"} Jul 09 20:03:25.210499 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:25.210466 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" event={"ID":"2908882a0397afa97d2c189b3c05786f","Type":"ContainerStarted","Data":"58c964b006af2be09461c747421abd6047454f33e98df55eb0e57a024156ae20"} Jul 09 20:03:25.226747 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:25.226692 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" podStartSLOduration=23.226677695 podStartE2EDuration="23.226677695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:25.226223161 +0000 UTC m=+25.683360400" watchObservedRunningTime="2026-07-09 20:03:25.226677695 +0000 UTC m=+25.683814934" Jul 09 20:03:26.090114 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:26.090079 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:26.090310 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:26.090218 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:26.216752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:26.216719 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:03:26.217257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:26.217172 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"f0d8851956b3786a30279a22369f1425aa3bcf019e570bf67301d5b0972a1d1c"} Jul 09 20:03:27.090180 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:27.090134 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:27.090396 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:27.090132 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:27.090396 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:27.090278 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:27.090396 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:27.090324 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:27.220823 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:27.220788 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" event={"ID":"fab34251-bd61-41e7-a20c-d0b7b310efa9","Type":"ContainerStarted","Data":"8c0d1a1dad7dd1b2457b94f282b4107a03e790fd7b55895c5abdb1b4df9bd23c"} Jul 09 20:03:27.238919 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:27.238871 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkjk8" podStartSLOduration=2.569543238 podStartE2EDuration="26.238856124s" totalImagesPullingTime="23.669312886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:27.23874825 +0000 UTC m=+27.695885489" watchObservedRunningTime="2026-07-09 20:03:27.238856124 +0000 UTC m=+27.695993363" Jul 09 20:03:27.885362 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:27.884974 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:27.885775 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:27.885731 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:28.090204 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:28.089988 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:28.090347 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:28.090239 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:28.226315 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:28.226285 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:03:28.226944 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:28.226641 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"633438bfaf919fcd6daedb7d02eb29f5a2e3770f2834d97ce92d7932cc7f019a"} Jul 09 20:03:28.227010 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:28.226991 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:28.227342 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:28.227323 2583 scope.go:117] "RemoveContainer" containerID="165d61a0fbc1b02d771c07d73bb724f2ee225734844e904302cb149a057c68ff" Jul 09 20:03:28.227473 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:28.227424 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6zcck" Jul 09 20:03:29.089956 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.089921 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:29.090128 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:29.090064 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:29.090128 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.090116 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:29.090309 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:29.090262 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:29.233861 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.233829 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:03:29.234323 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.234287 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" event={"ID":"7250d077-6ea3-4eba-b703-558f2ceffe18","Type":"ContainerStarted","Data":"765185897ef801691984b4e620051f57f0b011190f422236f946bbe65b53989c"} Jul 09 20:03:29.234818 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.234795 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:29.234922 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.234869 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:29.234922 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.234919 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:29.253412 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.253382 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:29.253622 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.253558 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:03:29.271768 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:29.271712 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" podStartSLOduration=7.632800202 podStartE2EDuration="28.271697195s" totalImagesPullingTime="20.638896993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:29.270057387 +0000 UTC m=+29.727194643" watchObservedRunningTime="2026-07-09 20:03:29.271697195 +0000 UTC m=+29.728834435" Jul 09 20:03:30.091094 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:30.091058 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:30.091303 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:30.091157 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:30.153832 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:30.153796 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8hmwh"] Jul 09 20:03:30.157014 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:30.156984 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k9bkk"] Jul 09 20:03:30.157180 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:30.157109 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:30.157276 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:30.157246 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:30.160082 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:30.160047 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x9whf"] Jul 09 20:03:30.160226 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:30.160136 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:30.160226 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:30.160219 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:30.236846 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:30.236818 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:30.237377 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:30.237329 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:32.089785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:32.089709 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:32.090161 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:32.089713 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:32.090161 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:32.089837 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:32.090161 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:32.089829 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:32.090161 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:32.089898 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:32.090161 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:32.090003 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:32.244709 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:32.244470 2583 generic.go:356] "Generic (PLEG): container finished" podID="c508b8a3-2f43-4f0c-841f-e766037c4858" containerID="55a2b65df4b0574176a3c763152a9aa6aa18d2bd342a6991f19a951e7ea1108a" exitCode=0 Jul 09 20:03:32.244857 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:32.244561 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" event={"ID":"c508b8a3-2f43-4f0c-841f-e766037c4858","Type":"ContainerDied","Data":"55a2b65df4b0574176a3c763152a9aa6aa18d2bd342a6991f19a951e7ea1108a"} Jul 09 20:03:33.796747 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:33.796707 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:33.796747 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:33.796768 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:33.797306 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:33.796873 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:33.797306 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:33.796874 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:33.797306 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:33.796926 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:04:05.796911889 +0000 UTC m=+66.254049107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 20:03:33.797306 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:33.796940 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret podName:3f591d68-dbcc-4d9c-9dab-cac01af2da3c nodeName:}" failed. No retries permitted until 2026-07-09 20:04:05.796934367 +0000 UTC m=+66.254071584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret") pod "global-pull-secret-syncer-8hmwh" (UID: "3f591d68-dbcc-4d9c-9dab-cac01af2da3c") : object "kube-system"/"original-pull-secret" not registered Jul 09 20:03:33.897296 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:33.897256 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:33.897493 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:33.897401 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 20:03:33.897493 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:33.897417 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 20:03:33.897493 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:33.897428 2583 projected.go:196] Error preparing data for projected volume kube-api-access-lkb5r for pod openshift-network-diagnostics/network-check-target-x9whf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:33.897633 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:33.897502 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r podName:1548b980-1173-46b0-b92b-92169bd6c64d nodeName:}" failed. No retries permitted until 2026-07-09 20:04:05.897489974 +0000 UTC m=+66.354627195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lkb5r" (UniqueName: "kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r") pod "network-check-target-x9whf" (UID: "1548b980-1173-46b0-b92b-92169bd6c64d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 20:03:34.090268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:34.090178 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:34.090268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:34.090178 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:34.090432 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:34.090283 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8hmwh" podUID="3f591d68-dbcc-4d9c-9dab-cac01af2da3c" Jul 09 20:03:34.090432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:34.090306 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:34.090432 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:34.090401 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:03:34.090578 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:34.090483 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x9whf" podUID="1548b980-1173-46b0-b92b-92169bd6c64d" Jul 09 20:03:34.251490 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:34.251458 2583 generic.go:356] "Generic (PLEG): container finished" podID="c508b8a3-2f43-4f0c-841f-e766037c4858" containerID="9c99854b1083a6f912f48d14e882d4154138ad77bb8ec1b0a92bcb3192fe2fe1" exitCode=0 Jul 09 20:03:34.251649 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:34.251504 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" event={"ID":"c508b8a3-2f43-4f0c-841f-e766037c4858","Type":"ContainerDied","Data":"9c99854b1083a6f912f48d14e882d4154138ad77bb8ec1b0a92bcb3192fe2fe1"} Jul 09 20:03:35.256600 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.256565 2583 generic.go:356] "Generic (PLEG): container finished" podID="c508b8a3-2f43-4f0c-841f-e766037c4858" containerID="6f4bad92a95bdb8d3480482871683fc1a0c693c8f584206a710f58a656d6addf" exitCode=0 Jul 09 20:03:35.257075 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.256626 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" event={"ID":"c508b8a3-2f43-4f0c-841f-e766037c4858","Type":"ContainerDied","Data":"6f4bad92a95bdb8d3480482871683fc1a0c693c8f584206a710f58a656d6addf"} Jul 09 20:03:35.849969 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.849893 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeReady" Jul 09 20:03:35.850105 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.850025 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 20:03:35.881044 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.881012 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dfdccb8df-ps6bs"] Jul 09 20:03:35.882840 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.882824 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:35.885330 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.885304 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 20:03:35.885489 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.885348 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 20:03:35.885489 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.885362 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9cv67\"" Jul 09 20:03:35.885604 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.885526 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 20:03:35.894331 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.894297 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 20:03:35.894715 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.894696 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lrrr2"] Jul 09 20:03:35.896507 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.896491 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:35.898296 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.898273 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dfdccb8df-ps6bs"] Jul 09 20:03:35.899144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.898962 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kpr8l"] Jul 09 20:03:35.900332 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.900314 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 20:03:35.900429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.900347 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 20:03:35.900429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.900350 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lrpv\"" Jul 09 20:03:35.900819 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.900798 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kpr8l" Jul 09 20:03:35.903567 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.903547 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 20:03:35.903675 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.903583 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 20:03:35.903675 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.903594 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 20:03:35.903675 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.903646 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-57xht\"" Jul 09 20:03:35.906104 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.906079 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lrrr2"] Jul 09 20:03:35.912115 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:35.912094 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kpr8l"] Jul 09 20:03:36.015820 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.015780 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k8jr\" (UniqueName: \"kubernetes.io/projected/9dd12031-29c3-4589-b254-a5464bda09a9-kube-api-access-9k8jr\") pod \"ingress-canary-kpr8l\" (UID: \"9dd12031-29c3-4589-b254-a5464bda09a9\") " pod="openshift-ingress-canary/ingress-canary-kpr8l" Jul 09 20:03:36.016000 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.015846 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dda0c331-3e63-4d6b-938c-6b570953e802-ca-trust-extracted\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.016000 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.015869 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-registry-certificates\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.016000 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.015909 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.016000 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.015925 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-installation-pull-secrets\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.016000 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.015944 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6lst\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-kube-api-access-f6lst\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.016000 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.015968 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-bound-sa-token\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.016283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.016022 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.016283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.016040 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-tmp-dir\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.016283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.016060 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-image-registry-private-configuration\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.016283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.016086 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-config-volume\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.016283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.016110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-trusted-ca\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.016283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.016131 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfbtj\" (UniqueName: \"kubernetes.io/projected/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-kube-api-access-sfbtj\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.016283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.016157 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dd12031-29c3-4589-b254-a5464bda09a9-cert\") pod \"ingress-canary-kpr8l\" (UID: \"9dd12031-29c3-4589-b254-a5464bda09a9\") " pod="openshift-ingress-canary/ingress-canary-kpr8l" Jul 09 20:03:36.090153 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.090126 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:03:36.090344 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.090126 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:03:36.090810 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.090557 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:03:36.093547 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.093520 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 20:03:36.093689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.093523 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 20:03:36.093689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.093526 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kv5k8\"" Jul 09 20:03:36.093689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.093617 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s29qd\"" Jul 09 20:03:36.093689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.093531 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 20:03:36.093689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.093531 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 20:03:36.116950 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.116924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117099 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.116977 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-installation-pull-secrets\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117099 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117004 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6lst\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-kube-api-access-f6lst\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117099 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-bound-sa-token\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117099 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.117099 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.117079 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:03:36.117099 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.117097 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:03:36.117099 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117099 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-tmp-dir\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-image-registry-private-configuration\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.117167 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:36.61714637 +0000 UTC m=+37.074283594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-config-volume\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117232 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-trusted-ca\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.117238 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfbtj\" (UniqueName: \"kubernetes.io/projected/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-kube-api-access-sfbtj\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.117292 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:36.617275517 +0000 UTC m=+37.074412743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117316 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dd12031-29c3-4589-b254-a5464bda09a9-cert\") pod \"ingress-canary-kpr8l\" (UID: \"9dd12031-29c3-4589-b254-a5464bda09a9\") " pod="openshift-ingress-canary/ingress-canary-kpr8l" Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117356 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k8jr\" (UniqueName: \"kubernetes.io/projected/9dd12031-29c3-4589-b254-a5464bda09a9-kube-api-access-9k8jr\") pod \"ingress-canary-kpr8l\" (UID: \"9dd12031-29c3-4589-b254-a5464bda09a9\") " pod="openshift-ingress-canary/ingress-canary-kpr8l" Jul 09 20:03:36.117421 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117410 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dda0c331-3e63-4d6b-938c-6b570953e802-ca-trust-extracted\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117893 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117441 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-registry-certificates\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117893 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117505 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-tmp-dir\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.117974 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117909 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dda0c331-3e63-4d6b-938c-6b570953e802-ca-trust-extracted\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.117974 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.117911 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-config-volume\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.118108 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.118089 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-registry-certificates\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.118327 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.118288 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-trusted-ca\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.121388 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.121364 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-image-registry-private-configuration\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.121513 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.121390 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-installation-pull-secrets\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.121564 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.121526 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dd12031-29c3-4589-b254-a5464bda09a9-cert\") pod \"ingress-canary-kpr8l\" (UID: \"9dd12031-29c3-4589-b254-a5464bda09a9\") " pod="openshift-ingress-canary/ingress-canary-kpr8l" Jul 09 20:03:36.126185 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.126152 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-bound-sa-token\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.126305 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.126280 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6lst\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-kube-api-access-f6lst\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.127158 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.127137 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k8jr\" (UniqueName: \"kubernetes.io/projected/9dd12031-29c3-4589-b254-a5464bda09a9-kube-api-access-9k8jr\") pod \"ingress-canary-kpr8l\" (UID: \"9dd12031-29c3-4589-b254-a5464bda09a9\") " pod="openshift-ingress-canary/ingress-canary-kpr8l" Jul 09 20:03:36.127274 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.127250 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfbtj\" (UniqueName: \"kubernetes.io/projected/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-kube-api-access-sfbtj\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.213016 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.212976 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kpr8l" Jul 09 20:03:36.364725 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.364393 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kpr8l"] Jul 09 20:03:36.368337 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:03:36.368305 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd12031_29c3_4589_b254_a5464bda09a9.slice/crio-f5279feeec8dd44701e33d53da4c9dcc80967c3e57319964b311d7b74f124c8d WatchSource:0}: Error finding container f5279feeec8dd44701e33d53da4c9dcc80967c3e57319964b311d7b74f124c8d: Status 404 returned error can't find the container with id f5279feeec8dd44701e33d53da4c9dcc80967c3e57319964b311d7b74f124c8d Jul 09 20:03:36.622632 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.622535 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:36.622632 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:36.622610 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:36.622851 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.622762 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:03:36.622851 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.622834 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:37.622818162 +0000 UTC m=+38.079955380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:03:36.622970 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.622765 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:03:36.622970 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.622874 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:03:36.623071 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:36.622994 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:37.622979036 +0000 UTC m=+38.080116255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:03:37.266224 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:37.266180 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kpr8l" event={"ID":"9dd12031-29c3-4589-b254-a5464bda09a9","Type":"ContainerStarted","Data":"f5279feeec8dd44701e33d53da4c9dcc80967c3e57319964b311d7b74f124c8d"} Jul 09 20:03:37.632512 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:37.632396 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:37.632512 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:37.632484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:37.633052 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:37.632587 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:03:37.633052 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:37.632589 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:03:37.633052 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:37.632619 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:03:37.633052 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:37.632650 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:39.632635073 +0000 UTC m=+40.089772295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:03:37.633052 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:37.632677 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:39.632659312 +0000 UTC m=+40.089796536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:03:39.651793 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:39.651751 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:39.652274 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:39.651818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:39.652274 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:39.651932 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:03:39.652274 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:39.651957 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:03:39.652274 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:39.652006 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:43.651992201 +0000 UTC m=+44.109129418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:03:39.652274 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:39.651940 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:03:39.652274 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:39.652071 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:43.652055454 +0000 UTC m=+44.109192679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:03:41.634490 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:41.634307 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:41.719002 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:41.718911 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:41.772175 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:41.772137 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:41.902063 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:41.902033 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:42.002256 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:42.002169 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:42.280703 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:42.280615 2583 generic.go:356] "Generic (PLEG): container finished" podID="c508b8a3-2f43-4f0c-841f-e766037c4858" containerID="d1367047d6144b18a0936f26b3872fcbbf12537010f7669784c78dc28b6f8f3e" exitCode=0 Jul 09 20:03:42.280703 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:42.280683 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" event={"ID":"c508b8a3-2f43-4f0c-841f-e766037c4858","Type":"ContainerDied","Data":"d1367047d6144b18a0936f26b3872fcbbf12537010f7669784c78dc28b6f8f3e"} Jul 09 20:03:42.282174 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:42.282153 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kpr8l" event={"ID":"9dd12031-29c3-4589-b254-a5464bda09a9","Type":"ContainerStarted","Data":"a14e9ab14ae830275f2e84061aa142d82b073cfaa964ff00af8e645d6637c773"} Jul 09 20:03:42.321605 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:42.321279 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kpr8l" podStartSLOduration=2.5214284769999997 podStartE2EDuration="7.321256998s" totalImagesPullingTime="4.799828521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:42.320517823 +0000 UTC m=+42.777655063" watchObservedRunningTime="2026-07-09 20:03:42.321256998 +0000 UTC m=+42.778394238" Jul 09 20:03:43.287851 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:43.287814 2583 generic.go:356] "Generic (PLEG): container finished" podID="c508b8a3-2f43-4f0c-841f-e766037c4858" containerID="864de7e8af7c46335762271518f61f4e96851687e0863a717482f3a287197ef7" exitCode=0 Jul 09 20:03:43.288231 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:43.287897 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" event={"ID":"c508b8a3-2f43-4f0c-841f-e766037c4858","Type":"ContainerDied","Data":"864de7e8af7c46335762271518f61f4e96851687e0863a717482f3a287197ef7"} Jul 09 20:03:43.338818 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:43.338631 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:43.391118 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:43.391083 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:43.684718 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:43.684683 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:43.684927 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:43.684740 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:43.684927 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:43.684839 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:03:43.684927 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:43.684846 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:03:43.684927 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:43.684859 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:03:43.684927 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:43.684915 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:51.684897479 +0000 UTC m=+52.142034715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:03:43.685113 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:43.684933 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:51.684924588 +0000 UTC m=+52.142061806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:03:44.293953 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:44.293921 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" event={"ID":"c508b8a3-2f43-4f0c-841f-e766037c4858","Type":"ContainerStarted","Data":"a7109171f95ea72c9b90eea005c84bd55b49d3e3c0a2a99e9e5884d87c691dad"} Jul 09 20:03:44.316617 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:44.316559 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jkcx6" podStartSLOduration=7.220426771 podStartE2EDuration="43.316540191s" totalImagesPullingTime="36.09611342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:44.315767462 +0000 UTC m=+44.772904701" watchObservedRunningTime="2026-07-09 20:03:44.316540191 +0000 UTC m=+44.773677432" Jul 09 20:03:44.326394 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:44.326353 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:44.385603 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:44.385571 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:44.438639 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:44.438606 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:44.510224 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:44.510189 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:44.611667 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:44.611578 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:47.675079 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:47.675042 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:51.747340 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:51.747299 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:03:51.747846 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:51.747352 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:03:51.747846 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:51.747473 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:03:51.747846 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:51.747491 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:03:51.747846 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:51.747496 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:03:51.747846 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:51.747544 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:04:07.747529612 +0000 UTC m=+68.204666834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:03:51.747846 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:03:51.747557 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:04:07.747551208 +0000 UTC m=+68.204688429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:03:54.415044 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:54.415006 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:03:54.479410 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:03:54.479376 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:01.260084 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:01.260049 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjzpj" Jul 09 20:04:01.411019 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:01.410959 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:01.474179 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:01.474136 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:03.576869 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:03.576826 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:03.675318 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:03.675267 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:04.477098 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:04.477040 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:04.575877 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:04.575821 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:05.629208 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.629178 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:05.677237 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.677181 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:05.855146 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.855100 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:04:05.855315 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.855174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:04:05.858342 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.858324 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 20:04:05.858482 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.858464 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 20:04:05.865365 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:05.865340 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 20:04:05.865519 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:05.865423 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:05:09.865402459 +0000 UTC m=+130.322539681 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : secret "metrics-daemon-secret" not found Jul 09 20:04:05.869360 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.869334 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f591d68-dbcc-4d9c-9dab-cac01af2da3c-original-pull-secret\") pod \"global-pull-secret-syncer-8hmwh\" (UID: \"3f591d68-dbcc-4d9c-9dab-cac01af2da3c\") " pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:04:05.955669 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.955622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:04:05.958588 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.958561 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 20:04:05.969054 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.969024 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 20:04:05.979680 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:05.979651 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkb5r\" (UniqueName: \"kubernetes.io/projected/1548b980-1173-46b0-b92b-92169bd6c64d-kube-api-access-lkb5r\") pod \"network-check-target-x9whf\" (UID: \"1548b980-1173-46b0-b92b-92169bd6c64d\") " pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:04:06.110082 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.110044 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kv5k8\"" Jul 09 20:04:06.111008 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.110991 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8hmwh" Jul 09 20:04:06.117758 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.117735 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:04:06.248824 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.248775 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8hmwh"] Jul 09 20:04:06.252313 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:04:06.252152 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f591d68_dbcc_4d9c_9dab_cac01af2da3c.slice/crio-1878db052eac1579e8a480c44e5a13b2a3f3df8c08e24cc0ba84eba27e6c8d8e WatchSource:0}: Error finding container 1878db052eac1579e8a480c44e5a13b2a3f3df8c08e24cc0ba84eba27e6c8d8e: Status 404 returned error can't find the container with id 1878db052eac1579e8a480c44e5a13b2a3f3df8c08e24cc0ba84eba27e6c8d8e Jul 09 20:04:06.265202 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.265171 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x9whf"] Jul 09 20:04:06.268539 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:04:06.268510 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1548b980_1173_46b0_b92b_92169bd6c64d.slice/crio-69c545ffe80df981e1d74e666dabcee7a4376a899cb6aeb03192b219d5175afe WatchSource:0}: Error finding container 69c545ffe80df981e1d74e666dabcee7a4376a899cb6aeb03192b219d5175afe: Status 404 returned error can't find the container with id 69c545ffe80df981e1d74e666dabcee7a4376a899cb6aeb03192b219d5175afe Jul 09 20:04:06.347082 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.347041 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x9whf" event={"ID":"1548b980-1173-46b0-b92b-92169bd6c64d","Type":"ContainerStarted","Data":"69c545ffe80df981e1d74e666dabcee7a4376a899cb6aeb03192b219d5175afe"} Jul 09 20:04:06.348167 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.348140 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8hmwh" event={"ID":"3f591d68-dbcc-4d9c-9dab-cac01af2da3c","Type":"ContainerStarted","Data":"1878db052eac1579e8a480c44e5a13b2a3f3df8c08e24cc0ba84eba27e6c8d8e"} Jul 09 20:04:06.482600 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.482506 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:06.580980 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.580950 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:06.940658 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.940624 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:06.989935 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:06.989886 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:07.771345 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:07.771286 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:04:07.771345 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:07.771349 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:04:07.771612 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:07.771484 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:04:07.771612 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:07.771504 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:04:07.771612 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:07.771511 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:04:07.771612 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:07.771575 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:04:39.771558391 +0000 UTC m=+100.228695615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:04:07.771612 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:07.771589 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:04:39.771583459 +0000 UTC m=+100.228720677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:04:12.366825 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:12.366783 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x9whf" event={"ID":"1548b980-1173-46b0-b92b-92169bd6c64d","Type":"ContainerStarted","Data":"b2622c765c8eca14665fa399ef41ae47201ddfa7714cfb11afe5c27e697c1fdf"} Jul 09 20:04:12.367305 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:12.366872 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:04:12.368208 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:12.368175 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8hmwh" event={"ID":"3f591d68-dbcc-4d9c-9dab-cac01af2da3c","Type":"ContainerStarted","Data":"207b15625b6727e5ce6facdee352b2008d53193df784befb54167f33538f6393"} Jul 09 20:04:12.382420 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:12.382365 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x9whf" podStartSLOduration=66.186270462 podStartE2EDuration="1m11.382350297s" totalImagesPullingTime="5.196079835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:04:12.380833304 +0000 UTC m=+72.837970552" watchObservedRunningTime="2026-07-09 20:04:12.382350297 +0000 UTC m=+72.839487516" Jul 09 20:04:12.393729 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:12.393676 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8hmwh" podStartSLOduration=66.182961358 podStartE2EDuration="1m11.393661387s" totalImagesPullingTime="5.210700029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:04:12.392920953 +0000 UTC m=+72.850058197" watchObservedRunningTime="2026-07-09 20:04:12.393661387 +0000 UTC m=+72.850798627" Jul 09 20:04:15.839900 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:15.839864 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:16.074516 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:16.074477 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:16.999313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:16.999279 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:17.081384 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:17.081347 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:26.581580 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:26.581545 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:26.632993 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:26.632965 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:32.460814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:32.460773 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:32.516531 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:32.516504 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:32.572101 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:32.572072 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:04:39.809464 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:39.809406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:04:39.809812 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:39.809510 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:04:39.809812 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:39.809579 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:04:39.809812 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:39.809599 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:04:39.809812 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:39.809617 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:04:39.809812 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:39.809667 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:05:43.809647968 +0000 UTC m=+164.266785186 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:04:39.809812 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:04:39.809682 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:05:43.809675786 +0000 UTC m=+164.266813003 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:04:43.373836 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:04:43.373801 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x9whf" Jul 09 20:05:09.915526 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:05:09.915477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:05:09.916003 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:09.915632 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 20:05:09.916003 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:09.915707 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:11.915690609 +0000 UTC m=+252.372827831 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : secret "metrics-daemon-secret" not found Jul 09 20:05:38.895688 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:38.895620 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" podUID="dda0c331-3e63-4d6b-938c-6b570953e802" Jul 09 20:05:38.907902 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:38.907870 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lrrr2" podUID="bf2c14ea-7c7e-401b-b1ef-c0d536b80326" Jul 09 20:05:39.101742 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:39.101688 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:05:39.576093 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:05:39.576061 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrrr2" Jul 09 20:05:39.576093 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:05:39.576090 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:05:43.859553 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:05:43.859517 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:05:43.859553 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:05:43.859566 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:05:43.860039 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:43.859678 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 20:05:43.860039 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:43.859682 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 20:05:43.860039 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:43.859699 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dfdccb8df-ps6bs: secret "image-registry-tls" not found Jul 09 20:05:43.860039 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:43.859747 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls podName:dda0c331-3e63-4d6b-938c-6b570953e802 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:45.859727807 +0000 UTC m=+286.316865039 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls") pod "image-registry-6dfdccb8df-ps6bs" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802") : secret "image-registry-tls" not found Jul 09 20:05:43.860039 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:05:43.859764 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls podName:bf2c14ea-7c7e-401b-b1ef-c0d536b80326 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:45.859755756 +0000 UTC m=+286.316892978 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls") pod "dns-default-lrrr2" (UID: "bf2c14ea-7c7e-401b-b1ef-c0d536b80326") : secret "dns-default-metrics-tls" not found Jul 09 20:05:50.091163 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:05:50.091125 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:06:49.918661 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:06:49.918629 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:11.984068 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:11.984008 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:07:11.984542 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:11.984165 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 20:07:11.984542 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:11.984246 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs podName:1367c363-01b3-4c1e-bc94-5e8bd1afef16 nodeName:}" failed. No retries permitted until 2026-07-09 20:09:13.984228496 +0000 UTC m=+374.441365715 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs") pod "network-metrics-daemon-k9bkk" (UID: "1367c363-01b3-4c1e-bc94-5e8bd1afef16") : secret "metrics-daemon-secret" not found Jul 09 20:07:15.271955 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.271918 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds"] Jul 09 20:07:15.273741 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.273718 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.274713 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.274686 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87"] Jul 09 20:07:15.276405 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.276385 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87" Jul 09 20:07:15.276528 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.276497 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 20:07:15.276528 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.276509 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 20:07:15.276884 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.276866 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 20:07:15.277810 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.277792 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 20:07:15.277918 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.277903 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vprx8\"" Jul 09 20:07:15.279071 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.279056 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w2dtp\"" Jul 09 20:07:15.283564 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.283537 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds"] Jul 09 20:07:15.290218 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.290193 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87"] Jul 09 20:07:15.369804 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.369767 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp"] Jul 09 20:07:15.371733 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.371713 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:15.374255 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.374228 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 20:07:15.374406 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.374233 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 20:07:15.374519 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.374502 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 20:07:15.374690 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.374672 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6n6fq\"" Jul 09 20:07:15.383258 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.383226 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp"] Jul 09 20:07:15.410277 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.410235 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/102309c1-eda2-40b9-81ce-6fe288b324f5-config\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.410500 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.410295 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/102309c1-eda2-40b9-81ce-6fe288b324f5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.410500 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.410348 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr6jp\" (UniqueName: \"kubernetes.io/projected/102309c1-eda2-40b9-81ce-6fe288b324f5-kube-api-access-rr6jp\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.410500 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.410417 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r95kz\" (UniqueName: \"kubernetes.io/projected/893f1a6d-a5e7-43ec-86eb-bae781a207dd-kube-api-access-r95kz\") pod \"network-check-source-869dcfcdcd-vqt87\" (UID: \"893f1a6d-a5e7-43ec-86eb-bae781a207dd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87" Jul 09 20:07:15.421943 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.421907 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:15.510989 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.510951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw9wl\" (UniqueName: \"kubernetes.io/projected/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-kube-api-access-gw9wl\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:15.511104 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.510994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/102309c1-eda2-40b9-81ce-6fe288b324f5-config\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.511104 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.511032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/102309c1-eda2-40b9-81ce-6fe288b324f5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.511104 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.511053 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr6jp\" (UniqueName: \"kubernetes.io/projected/102309c1-eda2-40b9-81ce-6fe288b324f5-kube-api-access-rr6jp\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.511104 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.511083 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r95kz\" (UniqueName: \"kubernetes.io/projected/893f1a6d-a5e7-43ec-86eb-bae781a207dd-kube-api-access-r95kz\") pod \"network-check-source-869dcfcdcd-vqt87\" (UID: \"893f1a6d-a5e7-43ec-86eb-bae781a207dd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87" Jul 09 20:07:15.511290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.511134 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:15.511640 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.511615 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/102309c1-eda2-40b9-81ce-6fe288b324f5-config\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.513470 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.513435 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/102309c1-eda2-40b9-81ce-6fe288b324f5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.519313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.519280 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r95kz\" (UniqueName: \"kubernetes.io/projected/893f1a6d-a5e7-43ec-86eb-bae781a207dd-kube-api-access-r95kz\") pod \"network-check-source-869dcfcdcd-vqt87\" (UID: \"893f1a6d-a5e7-43ec-86eb-bae781a207dd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87" Jul 09 20:07:15.519313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.519293 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr6jp\" (UniqueName: \"kubernetes.io/projected/102309c1-eda2-40b9-81ce-6fe288b324f5-kube-api-access-rr6jp\") pod \"service-ca-operator-7695fc6c8c-6b4ds\" (UID: \"102309c1-eda2-40b9-81ce-6fe288b324f5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.520789 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.520759 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:15.585062 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.584976 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" Jul 09 20:07:15.592243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.592213 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87" Jul 09 20:07:15.611593 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.611553 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:15.611802 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.611636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw9wl\" (UniqueName: \"kubernetes.io/projected/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-kube-api-access-gw9wl\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:15.611802 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:15.611753 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 20:07:15.611924 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:15.611838 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls podName:ebcd05a3-5471-4e8a-8d78-e81d2c3c884a nodeName:}" failed. No retries permitted until 2026-07-09 20:07:16.111817979 +0000 UTC m=+256.568955202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls") pod "cluster-samples-operator-65db858894-dcljp" (UID: "ebcd05a3-5471-4e8a-8d78-e81d2c3c884a") : secret "samples-operator-tls" not found Jul 09 20:07:15.622733 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.622699 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw9wl\" (UniqueName: \"kubernetes.io/projected/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-kube-api-access-gw9wl\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:15.726264 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.726228 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds"] Jul 09 20:07:15.729713 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:07:15.729683 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102309c1_eda2_40b9_81ce_6fe288b324f5.slice/crio-4203ad1661511004282b6e3f118ae9b7aa9ed6a7b8d6116c8efc917c84731e11 WatchSource:0}: Error finding container 4203ad1661511004282b6e3f118ae9b7aa9ed6a7b8d6116c8efc917c84731e11: Status 404 returned error can't find the container with id 4203ad1661511004282b6e3f118ae9b7aa9ed6a7b8d6116c8efc917c84731e11 Jul 09 20:07:15.744752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.744707 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87"] Jul 09 20:07:15.749006 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:07:15.748974 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893f1a6d_a5e7_43ec_86eb_bae781a207dd.slice/crio-811d7770d12ea1688003b71cceb47a5bce2992e30507b4c1b757ab07cbfea4c6 WatchSource:0}: Error finding container 811d7770d12ea1688003b71cceb47a5bce2992e30507b4c1b757ab07cbfea4c6: Status 404 returned error can't find the container with id 811d7770d12ea1688003b71cceb47a5bce2992e30507b4c1b757ab07cbfea4c6 Jul 09 20:07:15.808681 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.808645 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87" event={"ID":"893f1a6d-a5e7-43ec-86eb-bae781a207dd","Type":"ContainerStarted","Data":"ca847c6dd2c2ac7e44afec1ea448e4c1b964e5bf7c2e39881bc144ccad344e0a"} Jul 09 20:07:15.808846 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.808701 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87" event={"ID":"893f1a6d-a5e7-43ec-86eb-bae781a207dd","Type":"ContainerStarted","Data":"811d7770d12ea1688003b71cceb47a5bce2992e30507b4c1b757ab07cbfea4c6"} Jul 09 20:07:15.809945 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.809909 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" event={"ID":"102309c1-eda2-40b9-81ce-6fe288b324f5","Type":"ContainerStarted","Data":"4203ad1661511004282b6e3f118ae9b7aa9ed6a7b8d6116c8efc917c84731e11"} Jul 09 20:07:15.823999 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:15.823933 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-vqt87" podStartSLOduration=0.823909941 podStartE2EDuration="823.909941ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:15.823716917 +0000 UTC m=+256.280854152" watchObservedRunningTime="2026-07-09 20:07:15.823909941 +0000 UTC m=+256.281047181" Jul 09 20:07:16.114755 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:16.114711 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:16.114965 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:16.114885 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 20:07:16.114965 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:16.114952 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls podName:ebcd05a3-5471-4e8a-8d78-e81d2c3c884a nodeName:}" failed. No retries permitted until 2026-07-09 20:07:17.114936437 +0000 UTC m=+257.572073655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls") pod "cluster-samples-operator-65db858894-dcljp" (UID: "ebcd05a3-5471-4e8a-8d78-e81d2c3c884a") : secret "samples-operator-tls" not found Jul 09 20:07:16.379200 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:16.379112 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:16.430916 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:16.430884 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:17.123191 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:17.123162 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:17.123396 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:17.123353 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 20:07:17.123484 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:17.123430 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls podName:ebcd05a3-5471-4e8a-8d78-e81d2c3c884a nodeName:}" failed. No retries permitted until 2026-07-09 20:07:19.123409159 +0000 UTC m=+259.580546377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls") pod "cluster-samples-operator-65db858894-dcljp" (UID: "ebcd05a3-5471-4e8a-8d78-e81d2c3c884a") : secret "samples-operator-tls" not found Jul 09 20:07:17.884670 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:17.884599 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:17.940504 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:17.940464 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:18.820534 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:18.820491 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" event={"ID":"102309c1-eda2-40b9-81ce-6fe288b324f5","Type":"ContainerStarted","Data":"06dd3d59563a987e1c59b9c22b0e81312d7dd5f14ab60b11435f60cf4154d8c8"} Jul 09 20:07:18.836672 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:18.836621 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" podStartSLOduration=1.312381489 podStartE2EDuration="3.836603914s" totalImagesPullingTime="2.524222425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:18.835771285 +0000 UTC m=+259.292908525" watchObservedRunningTime="2026-07-09 20:07:18.836603914 +0000 UTC m=+259.293741153" Jul 09 20:07:19.141460 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:19.141413 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:19.141835 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:19.141575 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 20:07:19.141835 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:19.141640 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls podName:ebcd05a3-5471-4e8a-8d78-e81d2c3c884a nodeName:}" failed. No retries permitted until 2026-07-09 20:07:23.141624909 +0000 UTC m=+263.598762130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls") pod "cluster-samples-operator-65db858894-dcljp" (UID: "ebcd05a3-5471-4e8a-8d78-e81d2c3c884a") : secret "samples-operator-tls" not found Jul 09 20:07:19.189865 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:19.189830 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:19.282577 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:19.282539 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:19.884646 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:19.884610 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:19.963687 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:19.963654 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:20.046125 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.046074 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wjk8d"] Jul 09 20:07:20.048216 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.048192 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.051138 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.051110 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 20:07:20.051138 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.051130 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 20:07:20.051339 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.051111 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 20:07:20.051339 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.051111 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6wftc\"" Jul 09 20:07:20.051339 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.051111 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 20:07:20.060257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.060225 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wjk8d"] Jul 09 20:07:20.084192 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.084163 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:20.149584 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.149485 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-crio-socket\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.149584 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.149522 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.149584 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.149547 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmtb8\" (UniqueName: \"kubernetes.io/projected/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-api-access-wmtb8\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.150025 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.149645 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-data-volume\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.150025 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.149722 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.161517 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.161489 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:20.250435 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.250391 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-crio-socket\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.250435 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.250437 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.250704 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.250512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmtb8\" (UniqueName: \"kubernetes.io/projected/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-api-access-wmtb8\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.250704 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.250536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-crio-socket\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.250704 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.250556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-data-volume\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.250704 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:20.250633 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 20:07:20.250704 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.250641 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.250704 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:20.250702 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:20.750681287 +0000 UTC m=+261.207818517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : secret "insights-runtime-extractor-tls" not found Jul 09 20:07:20.250979 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:20.250729 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 20:07:20.250979 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:20.250794 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:20.750777124 +0000 UTC m=+261.207914346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : configmap "kube-rbac-proxy" not found Jul 09 20:07:20.251121 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.250994 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-data-volume\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.261080 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.261050 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmtb8\" (UniqueName: \"kubernetes.io/projected/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-api-access-wmtb8\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.263620 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.263591 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:20.754465 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.754364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.754465 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:20.754437 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:20.754642 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:20.754515 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 20:07:20.754642 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:20.754577 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 20:07:20.754642 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:20.754597 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:21.754578146 +0000 UTC m=+262.211715370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : configmap "kube-rbac-proxy" not found Jul 09 20:07:20.754642 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:20.754630 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:21.754619077 +0000 UTC m=+262.211756295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : secret "insights-runtime-extractor-tls" not found Jul 09 20:07:21.203268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:21.203236 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:21.253261 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:21.253216 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:21.522260 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:21.522179 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:21.572591 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:21.572555 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:21.762162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:21.762125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:21.762341 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:21.762211 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:21.762341 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:21.762251 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 20:07:21.762341 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:21.762321 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:23.762305855 +0000 UTC m=+264.219443079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : configmap "kube-rbac-proxy" not found Jul 09 20:07:21.762501 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:21.762371 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 20:07:21.762501 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:21.762463 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:23.762430064 +0000 UTC m=+264.219567281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : secret "insights-runtime-extractor-tls" not found Jul 09 20:07:21.841029 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:21.840945 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mhh5_af01d5f8-ca96-44ab-bc22-20cd38611e55/dns-node-resolver/0.log" Jul 09 20:07:22.432216 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:22.432186 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:23.176165 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:23.176122 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:23.176340 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:23.176273 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 20:07:23.176419 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:23.176343 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls podName:ebcd05a3-5471-4e8a-8d78-e81d2c3c884a nodeName:}" failed. No retries permitted until 2026-07-09 20:07:31.176325724 +0000 UTC m=+271.633462942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls") pod "cluster-samples-operator-65db858894-dcljp" (UID: "ebcd05a3-5471-4e8a-8d78-e81d2c3c884a") : secret "samples-operator-tls" not found Jul 09 20:07:23.239910 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:23.239879 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qtcr8_1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7/node-ca/0.log" Jul 09 20:07:23.780401 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:23.780364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:23.780764 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:23.780435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:23.780764 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:23.780516 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 20:07:23.780764 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:23.780578 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:27.780562763 +0000 UTC m=+268.237699982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : configmap "kube-rbac-proxy" not found Jul 09 20:07:23.780764 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:23.780589 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 20:07:23.780764 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:23.780632 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:27.780620846 +0000 UTC m=+268.237758068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : secret "insights-runtime-extractor-tls" not found Jul 09 20:07:23.840169 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:23.840143 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kpr8l_9dd12031-29c3-4589-b254-a5464bda09a9/serve-healthcheck-canary/0.log" Jul 09 20:07:24.942390 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:24.942350 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:25.043675 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:25.043644 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:25.152974 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:25.152943 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:25.254387 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:25.254300 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:25.353623 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:25.353590 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:25.543721 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:25.543632 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:25.697301 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:25.697265 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:26.494996 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:26.494967 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:27.098990 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:27.098961 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:27.300051 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:27.300015 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:27.692972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:27.692944 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:27.818214 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:27.818175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:27.818340 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:27.818238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:27.818340 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:27.818305 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 20:07:27.818411 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:27.818373 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 20:07:27.818411 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:27.818379 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:35.8183632 +0000 UTC m=+276.275500418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : configmap "kube-rbac-proxy" not found Jul 09 20:07:27.818509 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:27.818415 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls podName:e4457d7a-2334-470b-87c8-f2b7d3a8d72c nodeName:}" failed. No retries permitted until 2026-07-09 20:07:35.818403111 +0000 UTC m=+276.275540330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjk8d" (UID: "e4457d7a-2334-470b-87c8-f2b7d3a8d72c") : secret "insights-runtime-extractor-tls" not found Jul 09 20:07:27.897399 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:27.897361 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:28.300101 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:28.300065 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:28.499756 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:28.499716 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:28.601571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:28.601481 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:28.898134 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:28.898099 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:29.001105 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:29.001077 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:29.299516 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:29.299417 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:29.495399 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:29.495363 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:29.896966 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:29.896936 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:30.347059 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:30.346969 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:30.900663 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:30.900629 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:31.103236 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.103203 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:31.244634 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.244540 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:31.247224 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.247199 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebcd05a3-5471-4e8a-8d78-e81d2c3c884a-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dcljp\" (UID: \"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:31.281337 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.281298 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" Jul 09 20:07:31.299313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.299274 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:31.413651 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.413616 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp"] Jul 09 20:07:31.694200 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.694170 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:31.858319 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.858282 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" event={"ID":"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a","Type":"ContainerStarted","Data":"9807fca5fe4a29c3de2ea644de24f6dc843667818c59bfd80c029c41e921719e"} Jul 09 20:07:31.893627 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:31.893594 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:32.445722 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:32.445682 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:32.546146 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:32.546112 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:33.095592 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:33.095556 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:33.299352 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:33.299316 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:33.509477 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:33.509429 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:33.765413 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:33.765321 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:33.866770 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:33.866739 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" event={"ID":"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a","Type":"ContainerStarted","Data":"57f4f054ca4af1ae18d865c87b9a7a167e59790e7e588d374247e84f53c432f2"} Jul 09 20:07:33.866925 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:33.866795 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" event={"ID":"ebcd05a3-5471-4e8a-8d78-e81d2c3c884a","Type":"ContainerStarted","Data":"e73c9199ef1fbe538afafaff5f9851dc6686ac5cf3d4da8cac375235f8cdec8c"} Jul 09 20:07:33.880918 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:33.880861 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dcljp" podStartSLOduration=16.8645356 podStartE2EDuration="18.880843641s" totalImagesPullingTime="2.016308041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:33.879955322 +0000 UTC m=+274.337092561" watchObservedRunningTime="2026-07-09 20:07:33.880843641 +0000 UTC m=+274.337980881" Jul 09 20:07:34.697046 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:34.697012 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:34.899391 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:34.899361 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:35.095972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:35.095884 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:35.492912 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:35.492880 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:35.693109 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:35.693074 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:35.885427 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:35.885385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:35.885836 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:35.885477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:35.886003 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:35.885976 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:35.887995 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:35.887975 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4457d7a-2334-470b-87c8-f2b7d3a8d72c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjk8d\" (UID: \"e4457d7a-2334-470b-87c8-f2b7d3a8d72c\") " pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:35.958165 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:35.958126 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wjk8d" Jul 09 20:07:36.093546 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:07:36.093511 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4457d7a_2334_470b_87c8_f2b7d3a8d72c.slice/crio-a4efd12ba9523e1d624d10c351d244be208284b2471011edaca1f576c2861538 WatchSource:0}: Error finding container a4efd12ba9523e1d624d10c351d244be208284b2471011edaca1f576c2861538: Status 404 returned error can't find the container with id a4efd12ba9523e1d624d10c351d244be208284b2471011edaca1f576c2861538 Jul 09 20:07:36.093677 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:36.093619 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wjk8d"] Jul 09 20:07:36.882040 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:36.881977 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjk8d" event={"ID":"e4457d7a-2334-470b-87c8-f2b7d3a8d72c","Type":"ContainerStarted","Data":"a4efd12ba9523e1d624d10c351d244be208284b2471011edaca1f576c2861538"} Jul 09 20:07:39.892837 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:39.892803 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjk8d" event={"ID":"e4457d7a-2334-470b-87c8-f2b7d3a8d72c","Type":"ContainerStarted","Data":"f1b7c5fe0bca68607686df2fe1e5cc0eac29d0bd670ed3cdccf5ce6e436a4992"} Jul 09 20:07:40.524035 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.523999 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:40.617258 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.617174 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:40.898303 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.898262 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjk8d" event={"ID":"e4457d7a-2334-470b-87c8-f2b7d3a8d72c","Type":"ContainerStarted","Data":"7781c34b3736619680cf2f630179140532dafc1a0623a3f829f90b3284cab059"} Jul 09 20:07:40.898975 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.898953 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-ng8mp"] Jul 09 20:07:40.901990 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.901961 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-ng8mp" Jul 09 20:07:40.904502 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.904480 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h4p49\"" Jul 09 20:07:40.904619 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.904512 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 20:07:40.904619 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.904512 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 20:07:40.913354 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.913159 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-ng8mp"] Jul 09 20:07:40.914576 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.914544 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:40.929278 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:40.929240 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppphk\" (UniqueName: \"kubernetes.io/projected/2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31-kube-api-access-ppphk\") pod \"downloads-68c9cbb497-ng8mp\" (UID: \"2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31\") " pod="openshift-console/downloads-68c9cbb497-ng8mp" Jul 09 20:07:41.007795 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.007751 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:41.030306 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.030263 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppphk\" (UniqueName: \"kubernetes.io/projected/2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31-kube-api-access-ppphk\") pod \"downloads-68c9cbb497-ng8mp\" (UID: \"2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31\") " pod="openshift-console/downloads-68c9cbb497-ng8mp" Jul 09 20:07:41.041115 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.041080 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppphk\" (UniqueName: \"kubernetes.io/projected/2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31-kube-api-access-ppphk\") pod \"downloads-68c9cbb497-ng8mp\" (UID: \"2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31\") " pod="openshift-console/downloads-68c9cbb497-ng8mp" Jul 09 20:07:41.107837 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.107791 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:41.208167 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.208071 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:41.210849 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.210819 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-ng8mp" Jul 09 20:07:41.365022 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.364920 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-ng8mp"] Jul 09 20:07:41.367888 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:07:41.367854 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae5c1f2_4e28_4fc2_a68b_3a0c6585ab31.slice/crio-a370925272d6221b1628df2140cab2bc4dd0ecfc95817694f3779077818faa45 WatchSource:0}: Error finding container a370925272d6221b1628df2140cab2bc4dd0ecfc95817694f3779077818faa45: Status 404 returned error can't find the container with id a370925272d6221b1628df2140cab2bc4dd0ecfc95817694f3779077818faa45 Jul 09 20:07:41.381970 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.381936 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:41.575919 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.575833 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:41.635840 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.635802 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:41.902575 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.902538 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-ng8mp" event={"ID":"2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31","Type":"ContainerStarted","Data":"a370925272d6221b1628df2140cab2bc4dd0ecfc95817694f3779077818faa45"} Jul 09 20:07:41.964693 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:41.964652 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:42.576879 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:42.576834 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" podUID="dda0c331-3e63-4d6b-938c-6b570953e802" Jul 09 20:07:42.577045 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:42.576836 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lrrr2" podUID="bf2c14ea-7c7e-401b-b1ef-c0d536b80326" Jul 09 20:07:42.586316 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:42.586277 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:42.640159 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:42.640127 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:42.783573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:42.783536 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:42.906870 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:42.906839 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:07:42.907243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:42.906872 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrrr2" Jul 09 20:07:43.026695 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:43.026664 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:43.912320 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:43.912267 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjk8d" event={"ID":"e4457d7a-2334-470b-87c8-f2b7d3a8d72c","Type":"ContainerStarted","Data":"5a790b696303f4b42ba69ae3efcd9c6dc8475763927f465fab38bd7ad8ae7fc0"} Jul 09 20:07:43.929953 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:43.929901 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wjk8d" podStartSLOduration=17.245464666 podStartE2EDuration="23.929884896s" totalImagesPullingTime="6.68442023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:07:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:43.928656326 +0000 UTC m=+284.385793567" watchObservedRunningTime="2026-07-09 20:07:43.929884896 +0000 UTC m=+284.387022147" Jul 09 20:07:44.024504 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:44.024466 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:44.086253 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:44.086225 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:45.872727 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:45.872688 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:07:45.873119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:45.872740 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:07:45.875361 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:45.875333 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf2c14ea-7c7e-401b-b1ef-c0d536b80326-metrics-tls\") pod \"dns-default-lrrr2\" (UID: \"bf2c14ea-7c7e-401b-b1ef-c0d536b80326\") " pod="openshift-dns/dns-default-lrrr2" Jul 09 20:07:45.875425 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:45.875386 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"image-registry-6dfdccb8df-ps6bs\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:07:45.911210 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:45.911173 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lrpv\"" Jul 09 20:07:45.911210 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:45.911191 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9cv67\"" Jul 09 20:07:45.917663 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:45.917638 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:07:45.917828 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:45.917728 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrrr2" Jul 09 20:07:46.073605 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.073572 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dfdccb8df-ps6bs"] Jul 09 20:07:46.076761 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:07:46.076735 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda0c331_3e63_4d6b_938c_6b570953e802.slice/crio-b811d8902fe121d57e88893ef671effd304318c12c8e7a4f127f645ad30895cd WatchSource:0}: Error finding container b811d8902fe121d57e88893ef671effd304318c12c8e7a4f127f645ad30895cd: Status 404 returned error can't find the container with id b811d8902fe121d57e88893ef671effd304318c12c8e7a4f127f645ad30895cd Jul 09 20:07:46.088224 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.088192 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lrrr2"] Jul 09 20:07:46.091055 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:07:46.091022 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2c14ea_7c7e_401b_b1ef_c0d536b80326.slice/crio-0026f008ff261c205ef13d69f7627d360b89d5133231262a9816a7aad1feee37 WatchSource:0}: Error finding container 0026f008ff261c205ef13d69f7627d360b89d5133231262a9816a7aad1feee37: Status 404 returned error can't find the container with id 0026f008ff261c205ef13d69f7627d360b89d5133231262a9816a7aad1feee37 Jul 09 20:07:46.408487 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.408375 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:46.484290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.484210 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:46.925783 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.925743 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" event={"ID":"dda0c331-3e63-4d6b-938c-6b570953e802","Type":"ContainerStarted","Data":"0780beedae0b6baa551668c15dc4e505ea92d723e100a393c77f212c5b24e133"} Jul 09 20:07:46.926243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.925845 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" event={"ID":"dda0c331-3e63-4d6b-938c-6b570953e802","Type":"ContainerStarted","Data":"b811d8902fe121d57e88893ef671effd304318c12c8e7a4f127f645ad30895cd"} Jul 09 20:07:46.926243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.925923 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:07:46.927344 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.927318 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrrr2" event={"ID":"bf2c14ea-7c7e-401b-b1ef-c0d536b80326","Type":"ContainerStarted","Data":"0026f008ff261c205ef13d69f7627d360b89d5133231262a9816a7aad1feee37"} Jul 09 20:07:46.947134 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:46.947070 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" podStartSLOduration=285.947053677 podStartE2EDuration="4m45.947053677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:46.945768421 +0000 UTC m=+287.402905663" watchObservedRunningTime="2026-07-09 20:07:46.947053677 +0000 UTC m=+287.404190916" Jul 09 20:07:48.418819 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.418791 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79674967c4-rkrb6"] Jul 09 20:07:48.421846 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.421825 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.424209 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.424189 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 20:07:48.424335 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.424290 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 20:07:48.425522 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.425498 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 20:07:48.425700 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.425545 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 20:07:48.425700 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.425574 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-twwfz\"" Jul 09 20:07:48.425700 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.425585 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 20:07:48.430260 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.430234 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79674967c4-rkrb6"] Jul 09 20:07:48.496117 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.496086 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-service-ca\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.496250 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.496124 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfnm7\" (UniqueName: \"kubernetes.io/projected/d91468f5-17d9-44e9-b5c0-e195b6283d56-kube-api-access-bfnm7\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.496250 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.496150 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-oauth-config\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.496250 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.496167 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-serving-cert\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.496358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.496273 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-config\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.496358 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.496340 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-oauth-serving-cert\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.597752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.597348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-oauth-serving-cert\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.597752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.597436 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-service-ca\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.597752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.597505 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfnm7\" (UniqueName: \"kubernetes.io/projected/d91468f5-17d9-44e9-b5c0-e195b6283d56-kube-api-access-bfnm7\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.597752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.597662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-oauth-config\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.597752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.597697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-serving-cert\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.597752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.597738 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-config\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.598195 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.598167 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-service-ca\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.598587 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.598565 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-config\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.598658 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.598601 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-oauth-serving-cert\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.600844 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.600814 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-serving-cert\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.600956 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.600863 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-oauth-config\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.609713 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.609680 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfnm7\" (UniqueName: \"kubernetes.io/projected/d91468f5-17d9-44e9-b5c0-e195b6283d56-kube-api-access-bfnm7\") pod \"console-79674967c4-rkrb6\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.732865 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.732764 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:48.902017 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.901987 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79674967c4-rkrb6"] Jul 09 20:07:48.905164 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:07:48.905135 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91468f5_17d9_44e9_b5c0_e195b6283d56.slice/crio-d4036ec53b4ae8b63124e0dc61e12976b80ac3b68430aeffc00a92d906cc8dd1 WatchSource:0}: Error finding container d4036ec53b4ae8b63124e0dc61e12976b80ac3b68430aeffc00a92d906cc8dd1: Status 404 returned error can't find the container with id d4036ec53b4ae8b63124e0dc61e12976b80ac3b68430aeffc00a92d906cc8dd1 Jul 09 20:07:48.935769 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.935729 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrrr2" event={"ID":"bf2c14ea-7c7e-401b-b1ef-c0d536b80326","Type":"ContainerStarted","Data":"74095f59ed8f69aca2a4285b03b48bd11ed3b74d44b28c71c61db45dab3ac30e"} Jul 09 20:07:48.935969 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.935792 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrrr2" event={"ID":"bf2c14ea-7c7e-401b-b1ef-c0d536b80326","Type":"ContainerStarted","Data":"0521f433e43525492b507c819b0e322a209bdb241ce1a61fc448fe93637220cc"} Jul 09 20:07:48.935969 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.935864 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lrrr2" Jul 09 20:07:48.937223 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.937195 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79674967c4-rkrb6" event={"ID":"d91468f5-17d9-44e9-b5c0-e195b6283d56","Type":"ContainerStarted","Data":"d4036ec53b4ae8b63124e0dc61e12976b80ac3b68430aeffc00a92d906cc8dd1"} Jul 09 20:07:48.950785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:48.950730 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lrrr2" podStartSLOduration=251.625573549 podStartE2EDuration="4m13.950710424s" totalImagesPullingTime="2.325136875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:48.950572492 +0000 UTC m=+289.407709732" watchObservedRunningTime="2026-07-09 20:07:48.950710424 +0000 UTC m=+289.407847667" Jul 09 20:07:49.175432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:49.175383 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:49.276329 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:49.276290 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:49.655493 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:49.655464 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:49.754284 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:49.754244 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:49.826103 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:49.826072 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:49.968875 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:49.968776 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:50.216933 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:50.216898 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:52.007135 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.007094 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:52.060343 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.060297 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:52.835831 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.835738 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:52.870641 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.870604 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-v8x7p"] Jul 09 20:07:52.873940 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.873919 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:52.876595 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.876570 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 20:07:52.876727 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.876584 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 20:07:52.877765 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.877739 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 20:07:52.877872 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.877741 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 20:07:52.877872 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.877865 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xzh9b\"" Jul 09 20:07:52.878005 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.877776 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 20:07:52.883397 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.883374 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-v8x7p"] Jul 09 20:07:52.903578 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.903521 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:52.935091 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.935054 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:52.935247 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.935095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:52.935247 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.935154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:52.935247 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.935196 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqdgt\" (UniqueName: \"kubernetes.io/projected/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-kube-api-access-bqdgt\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:52.954518 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.954478 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79674967c4-rkrb6" event={"ID":"d91468f5-17d9-44e9-b5c0-e195b6283d56","Type":"ContainerStarted","Data":"a21724c7bd32342c6b14393c51abc643eb233297a3c5e72d80fea25e4f49b18a"} Jul 09 20:07:52.971175 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:52.971128 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79674967c4-rkrb6" podStartSLOduration=1.337277495 podStartE2EDuration="4.971112123s" totalImagesPullingTime="3.633834628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:52.969611856 +0000 UTC m=+293.426749095" watchObservedRunningTime="2026-07-09 20:07:52.971112123 +0000 UTC m=+293.428249362" Jul 09 20:07:53.036355 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.036306 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.036814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.036391 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.036814 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:53.036526 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 20:07:53.036814 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:53.036592 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-tls podName:4fbc0815-2403-4a3f-8d37-07d7d0b3423b nodeName:}" failed. No retries permitted until 2026-07-09 20:07:53.536569733 +0000 UTC m=+293.993706954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-tls") pod "prometheus-operator-64785b6675-v8x7p" (UID: "4fbc0815-2403-4a3f-8d37-07d7d0b3423b") : secret "prometheus-operator-tls" not found Jul 09 20:07:53.036814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.036633 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.036814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.036731 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqdgt\" (UniqueName: \"kubernetes.io/projected/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-kube-api-access-bqdgt\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.037148 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.037113 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.039341 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.039311 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.045468 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.045426 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqdgt\" (UniqueName: \"kubernetes.io/projected/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-kube-api-access-bqdgt\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.091889 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:53.091806 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k9bkk" podUID="1367c363-01b3-4c1e-bc94-5e8bd1afef16" Jul 09 20:07:53.136720 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.136669 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:53.541889 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.541852 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.544860 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.544837 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbc0815-2403-4a3f-8d37-07d7d0b3423b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-v8x7p\" (UID: \"4fbc0815-2403-4a3f-8d37-07d7d0b3423b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.785381 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.785344 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" Jul 09 20:07:53.921060 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.921028 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-v8x7p"] Jul 09 20:07:53.923648 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:07:53.923615 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbc0815_2403_4a3f_8d37_07d7d0b3423b.slice/crio-108ae31519ba980cbe7ab243efbde612bf83010722c8fadeb5306e19151733e3 WatchSource:0}: Error finding container 108ae31519ba980cbe7ab243efbde612bf83010722c8fadeb5306e19151733e3: Status 404 returned error can't find the container with id 108ae31519ba980cbe7ab243efbde612bf83010722c8fadeb5306e19151733e3 Jul 09 20:07:53.960479 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:53.960424 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" event={"ID":"4fbc0815-2403-4a3f-8d37-07d7d0b3423b","Type":"ContainerStarted","Data":"108ae31519ba980cbe7ab243efbde612bf83010722c8fadeb5306e19151733e3"} Jul 09 20:07:54.405413 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:54.405379 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:54.465378 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:54.465319 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:55.941017 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:55.940925 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:55.970249 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:55.970147 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" event={"ID":"4fbc0815-2403-4a3f-8d37-07d7d0b3423b","Type":"ContainerStarted","Data":"bb98e94a0d44df829f066feb47727bf6d55e049eebb5492bf4020a4440ab3648"} Jul 09 20:07:55.970249 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:55.970212 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" event={"ID":"4fbc0815-2403-4a3f-8d37-07d7d0b3423b","Type":"ContainerStarted","Data":"b203f034bde2758e3079759379b4e311db54e4488b360473f8c0244d82383aab"} Jul 09 20:07:55.987207 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:55.987140 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-v8x7p" podStartSLOduration=2.256027927 podStartE2EDuration="3.987117157s" totalImagesPullingTime="1.73108923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:55.98547871 +0000 UTC m=+296.442615954" watchObservedRunningTime="2026-07-09 20:07:55.987117157 +0000 UTC m=+296.444254397" Jul 09 20:07:56.604202 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:56.604151 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:56.705136 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:56.705105 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:57.407818 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:57.407775 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:57.459846 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:57.459787 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:57.964950 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:57.964910 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:58.178646 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.178595 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:58.227090 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.227003 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z8cbm"] Jul 09 20:07:58.269602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.269564 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:58.325835 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.325797 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:58.326245 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.326227 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mx5sd"] Jul 09 20:07:58.326386 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.326359 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.329643 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.329620 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 20:07:58.330571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.330539 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9chlm\"" Jul 09 20:07:58.330571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.330550 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 20:07:58.330753 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.330679 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 20:07:58.346726 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.346700 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z8cbm"] Jul 09 20:07:58.346872 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.346838 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.350424 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.350398 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pnzg7\"" Jul 09 20:07:58.350641 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.350620 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 20:07:58.351564 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.351542 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 20:07:58.351670 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.351542 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 20:07:58.386774 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.386743 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.386977 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.386788 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.386977 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.386819 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46s2v\" (UniqueName: \"kubernetes.io/projected/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-api-access-46s2v\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.386977 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.386920 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/487fa520-9f5e-4f2f-a85f-edd7907fab3f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.387099 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.387027 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487fa520-9f5e-4f2f-a85f-edd7907fab3f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.387099 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.387066 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.439567 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.439528 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:58.488246 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488145 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzlpq\" (UniqueName: \"kubernetes.io/projected/af2b69e0-b56f-40e1-986f-0c2acb0392f2-kube-api-access-qzlpq\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488246 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488205 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.488521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.488521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488298 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46s2v\" (UniqueName: \"kubernetes.io/projected/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-api-access-46s2v\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.488521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-wtmp\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488364 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-root\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488395 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/487fa520-9f5e-4f2f-a85f-edd7907fab3f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.488521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488419 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488476 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-sys\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488507 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488911 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488554 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af2b69e0-b56f-40e1-986f-0c2acb0392f2-metrics-client-ca\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488911 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488581 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-tls\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488911 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487fa520-9f5e-4f2f-a85f-edd7907fab3f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.488911 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488632 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.488911 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.488662 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-textfile\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.488911 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:58.488848 2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 20:07:58.488911 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:07:58.488909 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-tls podName:487fa520-9f5e-4f2f-a85f-edd7907fab3f nodeName:}" failed. No retries permitted until 2026-07-09 20:07:58.988890858 +0000 UTC m=+299.446028091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-z8cbm" (UID: "487fa520-9f5e-4f2f-a85f-edd7907fab3f") : secret "kube-state-metrics-tls" not found Jul 09 20:07:58.489277 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.489089 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/487fa520-9f5e-4f2f-a85f-edd7907fab3f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.489277 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.489114 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.489348 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.489310 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487fa520-9f5e-4f2f-a85f-edd7907fab3f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.491403 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.491383 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.499987 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.499953 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46s2v\" (UniqueName: \"kubernetes.io/projected/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-api-access-46s2v\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.540851 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.540817 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:58.589382 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589598 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589399 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-sys\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589598 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589429 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589598 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589520 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-sys\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589786 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589606 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af2b69e0-b56f-40e1-986f-0c2acb0392f2-metrics-client-ca\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589786 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589633 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-tls\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589786 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589675 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-textfile\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589786 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589719 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzlpq\" (UniqueName: \"kubernetes.io/projected/af2b69e0-b56f-40e1-986f-0c2acb0392f2-kube-api-access-qzlpq\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589980 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589784 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-wtmp\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589980 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589813 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-root\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.589980 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589887 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-root\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.590082 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.589997 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-wtmp\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.590082 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.590058 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.590185 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.590147 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af2b69e0-b56f-40e1-986f-0c2acb0392f2-metrics-client-ca\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.590234 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.590221 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-textfile\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.592346 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.592313 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-tls\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.593045 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.593013 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af2b69e0-b56f-40e1-986f-0c2acb0392f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.597580 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.597557 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzlpq\" (UniqueName: \"kubernetes.io/projected/af2b69e0-b56f-40e1-986f-0c2acb0392f2-kube-api-access-qzlpq\") pod \"node-exporter-mx5sd\" (UID: \"af2b69e0-b56f-40e1-986f-0c2acb0392f2\") " pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.640307 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.640269 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:58.658653 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.658617 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mx5sd" Jul 09 20:07:58.733827 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.733781 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:58.734009 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.733853 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:07:58.735554 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.735520 2583 patch_prober.go:28] interesting pod/console-79674967c4-rkrb6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body= Jul 09 20:07:58.735677 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.735607 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-79674967c4-rkrb6" podUID="d91468f5-17d9-44e9-b5c0-e195b6283d56" containerName="console" probeResult="failure" output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" Jul 09 20:07:58.943752 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.943723 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lrrr2" Jul 09 20:07:58.954251 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.954210 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:58.994467 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.994414 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:58.997563 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:58.997536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/487fa520-9f5e-4f2f-a85f-edd7907fab3f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z8cbm\" (UID: \"487fa520-9f5e-4f2f-a85f-edd7907fab3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:59.179737 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:59.179706 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:59.237277 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:59.237194 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" Jul 09 20:07:59.265709 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:59.265670 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:07:59.680604 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:07:59.680556 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:00.187255 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.187213 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4"] Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.203290 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4"] Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.203471 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.206358 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.206434 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.206469 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f13l5sc9aqq2i\"" Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.206758 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wdsc9\"" Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.206831 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.206909 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 20:08:00.285257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.206959 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 20:08:00.309412 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.309368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-tls\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.309610 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.309435 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.309610 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.309487 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.309610 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.309509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-grpc-tls\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.309610 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.309566 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.309806 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.309661 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.309806 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.309691 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bed066a7-4dc2-409d-9f42-b243382abf84-metrics-client-ca\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.309806 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.309721 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvv8d\" (UniqueName: \"kubernetes.io/projected/bed066a7-4dc2-409d-9f42-b243382abf84-kube-api-access-hvv8d\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.410705 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.410670 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvv8d\" (UniqueName: \"kubernetes.io/projected/bed066a7-4dc2-409d-9f42-b243382abf84-kube-api-access-hvv8d\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.410907 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.410721 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-tls\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.410907 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.410755 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.410907 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.410786 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.410907 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.410816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-grpc-tls\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.410907 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.410848 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.410907 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.410902 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.411283 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.410938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bed066a7-4dc2-409d-9f42-b243382abf84-metrics-client-ca\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.411767 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.411734 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bed066a7-4dc2-409d-9f42-b243382abf84-metrics-client-ca\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.414462 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.414347 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.414462 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.414395 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.414650 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.414478 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.414956 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.414928 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-grpc-tls\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.415085 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.414936 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-tls\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.415366 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.415342 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bed066a7-4dc2-409d-9f42-b243382abf84-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.419138 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.419108 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvv8d\" (UniqueName: \"kubernetes.io/projected/bed066a7-4dc2-409d-9f42-b243382abf84-kube-api-access-hvv8d\") pod \"thanos-querier-5cbf6ccfff-nbpd4\" (UID: \"bed066a7-4dc2-409d-9f42-b243382abf84\") " pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:00.516374 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:00.516270 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:01.134393 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:01.134361 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:01.233377 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:01.233337 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:01.591826 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:01.591690 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:01.650808 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:01.650756 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:02.044671 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.044616 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:02.146213 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.146167 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:02.247081 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.247047 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:02.504135 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.504100 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69dbc768-ms787"] Jul 09 20:08:02.522230 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.522194 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69dbc768-ms787"] Jul 09 20:08:02.522404 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.522339 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.525325 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.525286 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 20:08:02.526616 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.526489 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 20:08:02.526616 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.526504 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 20:08:02.526616 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.526498 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7kqdm\"" Jul 09 20:08:02.526616 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.526599 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1mgiuqssitsda\"" Jul 09 20:08:02.526906 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.526671 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 20:08:02.609224 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.609176 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:02.634309 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.634265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d29f86cb-414e-47f8-8e6f-9120009c2d0e-metrics-server-audit-profiles\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.634538 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.634330 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-secret-metrics-server-tls\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.634538 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.634406 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d29f86cb-414e-47f8-8e6f-9120009c2d0e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.634538 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.634494 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m4sw\" (UniqueName: \"kubernetes.io/projected/d29f86cb-414e-47f8-8e6f-9120009c2d0e-kube-api-access-8m4sw\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.634538 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.634524 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d29f86cb-414e-47f8-8e6f-9120009c2d0e-audit-log\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.634748 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.634544 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-client-ca-bundle\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.634748 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.634626 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-secret-metrics-server-client-certs\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.736008 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.735970 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m4sw\" (UniqueName: \"kubernetes.io/projected/d29f86cb-414e-47f8-8e6f-9120009c2d0e-kube-api-access-8m4sw\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.736201 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.736027 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d29f86cb-414e-47f8-8e6f-9120009c2d0e-audit-log\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.736201 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.736054 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-client-ca-bundle\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.736201 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.736118 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-secret-metrics-server-client-certs\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.736201 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.736188 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d29f86cb-414e-47f8-8e6f-9120009c2d0e-metrics-server-audit-profiles\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.736419 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.736220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-secret-metrics-server-tls\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.736419 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.736254 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d29f86cb-414e-47f8-8e6f-9120009c2d0e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.736680 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.736602 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d29f86cb-414e-47f8-8e6f-9120009c2d0e-audit-log\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.737250 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.737173 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d29f86cb-414e-47f8-8e6f-9120009c2d0e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.737644 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.737619 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d29f86cb-414e-47f8-8e6f-9120009c2d0e-metrics-server-audit-profiles\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.739364 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.739340 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-client-ca-bundle\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.739625 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.739602 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-secret-metrics-server-tls\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.739719 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.739698 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d29f86cb-414e-47f8-8e6f-9120009c2d0e-secret-metrics-server-client-certs\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.745742 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.745716 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m4sw\" (UniqueName: \"kubernetes.io/projected/d29f86cb-414e-47f8-8e6f-9120009c2d0e-kube-api-access-8m4sw\") pod \"metrics-server-69dbc768-ms787\" (UID: \"d29f86cb-414e-47f8-8e6f-9120009c2d0e\") " pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.834998 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.834907 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:02.974066 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.974031 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dfdccb8df-ps6bs"] Jul 09 20:08:02.980515 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.980476 2583 patch_prober.go:28] interesting pod/image-registry-6dfdccb8df-ps6bs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 20:08:02.980685 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:02.980542 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" podUID="dda0c331-3e63-4d6b-938c-6b570953e802" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 20:08:03.031163 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.031122 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79674967c4-rkrb6"] Jul 09 20:08:03.037537 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.037505 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm"] Jul 09 20:08:03.052969 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.052503 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm"] Jul 09 20:08:03.052969 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.052599 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:03.056164 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.056136 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b2nz8\"" Jul 09 20:08:03.056423 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.056292 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 20:08:03.140096 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.140056 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ed69cda-db0d-4799-a5f9-39fb4350f0e9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-n4dvm\" (UID: \"7ed69cda-db0d-4799-a5f9-39fb4350f0e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:03.140284 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.140159 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncmg8\" (UniqueName: \"kubernetes.io/projected/7ed69cda-db0d-4799-a5f9-39fb4350f0e9-kube-api-access-ncmg8\") pod \"monitoring-plugin-5f68df7f58-n4dvm\" (UID: \"7ed69cda-db0d-4799-a5f9-39fb4350f0e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:03.240785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.240726 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncmg8\" (UniqueName: \"kubernetes.io/projected/7ed69cda-db0d-4799-a5f9-39fb4350f0e9-kube-api-access-ncmg8\") pod \"monitoring-plugin-5f68df7f58-n4dvm\" (UID: \"7ed69cda-db0d-4799-a5f9-39fb4350f0e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:03.241235 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.240835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ed69cda-db0d-4799-a5f9-39fb4350f0e9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-n4dvm\" (UID: \"7ed69cda-db0d-4799-a5f9-39fb4350f0e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:03.243907 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.243875 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ed69cda-db0d-4799-a5f9-39fb4350f0e9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-n4dvm\" (UID: \"7ed69cda-db0d-4799-a5f9-39fb4350f0e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:03.248908 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.248880 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncmg8\" (UniqueName: \"kubernetes.io/projected/7ed69cda-db0d-4799-a5f9-39fb4350f0e9-kube-api-access-ncmg8\") pod \"monitoring-plugin-5f68df7f58-n4dvm\" (UID: \"7ed69cda-db0d-4799-a5f9-39fb4350f0e9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:03.366054 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.366012 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:03.965602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:03.965566 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:04.399263 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.399204 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:04.723110 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.722737 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 20:08:04.763850 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.763475 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:08:04.770559 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.767304 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:08:04.774393 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.774338 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 20:08:04.891365 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.891256 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69dbc768-ms787"] Jul 09 20:08:04.917920 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.917773 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z8cbm"] Jul 09 20:08:04.935920 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.935885 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4"] Jul 09 20:08:04.952852 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:04.952722 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm"] Jul 09 20:08:05.007097 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:05.006999 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mx5sd" event={"ID":"af2b69e0-b56f-40e1-986f-0c2acb0392f2","Type":"ContainerStarted","Data":"fb75ab482b330fdf3524336d1a09e6afe57a1d08fe7a5f98f81b98a6b65c2177"} Jul 09 20:08:05.060650 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:08:05.060606 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd29f86cb_414e_47f8_8e6f_9120009c2d0e.slice/crio-665c26d8e35f0797a1aaf30590e589690bc49b93cd82cff18097c993ecc6921e WatchSource:0}: Error finding container 665c26d8e35f0797a1aaf30590e589690bc49b93cd82cff18097c993ecc6921e: Status 404 returned error can't find the container with id 665c26d8e35f0797a1aaf30590e589690bc49b93cd82cff18097c993ecc6921e Jul 09 20:08:05.061419 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:08:05.061390 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487fa520_9f5e_4f2f_a85f_edd7907fab3f.slice/crio-7e57f0a1c10b345d95d21d88b7544c4286a59f46f2689f1e4b6427a4985df988 WatchSource:0}: Error finding container 7e57f0a1c10b345d95d21d88b7544c4286a59f46f2689f1e4b6427a4985df988: Status 404 returned error can't find the container with id 7e57f0a1c10b345d95d21d88b7544c4286a59f46f2689f1e4b6427a4985df988 Jul 09 20:08:05.062483 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:08:05.062242 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed066a7_4dc2_409d_9f42_b243382abf84.slice/crio-841e28ebb2a04a6398aeaa0e0f497e2a773f7e6671f3801eaf980524dfe76305 WatchSource:0}: Error finding container 841e28ebb2a04a6398aeaa0e0f497e2a773f7e6671f3801eaf980524dfe76305: Status 404 returned error can't find the container with id 841e28ebb2a04a6398aeaa0e0f497e2a773f7e6671f3801eaf980524dfe76305 Jul 09 20:08:05.063268 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:08:05.063226 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed69cda_db0d_4799_a5f9_39fb4350f0e9.slice/crio-7ff27427dafabae98f69db3992c66d7ea48fb74039e0ec5095bff42ea544bd4f WatchSource:0}: Error finding container 7ff27427dafabae98f69db3992c66d7ea48fb74039e0ec5095bff42ea544bd4f: Status 404 returned error can't find the container with id 7ff27427dafabae98f69db3992c66d7ea48fb74039e0ec5095bff42ea544bd4f Jul 09 20:08:06.018333 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.018283 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" event={"ID":"487fa520-9f5e-4f2f-a85f-edd7907fab3f","Type":"ContainerStarted","Data":"7e57f0a1c10b345d95d21d88b7544c4286a59f46f2689f1e4b6427a4985df988"} Jul 09 20:08:06.023432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.023395 2583 generic.go:356] "Generic (PLEG): container finished" podID="af2b69e0-b56f-40e1-986f-0c2acb0392f2" containerID="48a2132f82e8569c99bc8cfe37bf477420fa6b43f7cf33130766142dfad5db7b" exitCode=0 Jul 09 20:08:06.023665 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.023531 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mx5sd" event={"ID":"af2b69e0-b56f-40e1-986f-0c2acb0392f2","Type":"ContainerDied","Data":"48a2132f82e8569c99bc8cfe37bf477420fa6b43f7cf33130766142dfad5db7b"} Jul 09 20:08:06.030813 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.030537 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-ng8mp" event={"ID":"2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31","Type":"ContainerStarted","Data":"35950d2894d3d9e702681bb60e99aacb8e45dbd2dc30b68ea2ea73f3e8555d3c"} Jul 09 20:08:06.032364 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.032297 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-ng8mp" Jul 09 20:08:06.033404 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.033243 2583 patch_prober.go:28] interesting pod/downloads-68c9cbb497-ng8mp container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.13:8080/\": dial tcp 10.132.0.13:8080: connect: connection refused" start-of-body= Jul 09 20:08:06.033404 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.033302 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-ng8mp" podUID="2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.13:8080/\": dial tcp 10.132.0.13:8080: connect: connection refused" Jul 09 20:08:06.037096 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.037065 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69dbc768-ms787" event={"ID":"d29f86cb-414e-47f8-8e6f-9120009c2d0e","Type":"ContainerStarted","Data":"665c26d8e35f0797a1aaf30590e589690bc49b93cd82cff18097c993ecc6921e"} Jul 09 20:08:06.042216 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.042148 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" event={"ID":"7ed69cda-db0d-4799-a5f9-39fb4350f0e9","Type":"ContainerStarted","Data":"7ff27427dafabae98f69db3992c66d7ea48fb74039e0ec5095bff42ea544bd4f"} Jul 09 20:08:06.044848 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.044821 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" event={"ID":"bed066a7-4dc2-409d-9f42-b243382abf84","Type":"ContainerStarted","Data":"841e28ebb2a04a6398aeaa0e0f497e2a773f7e6671f3801eaf980524dfe76305"} Jul 09 20:08:06.070403 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:06.068962 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-ng8mp" podStartSLOduration=1.732235234 podStartE2EDuration="26.068937525s" totalImagesPullingTime="24.336702291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:06.068365031 +0000 UTC m=+306.525502276" watchObservedRunningTime="2026-07-09 20:08:06.068937525 +0000 UTC m=+306.526074766" Jul 09 20:08:07.058465 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:07.058391 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mx5sd" event={"ID":"af2b69e0-b56f-40e1-986f-0c2acb0392f2","Type":"ContainerStarted","Data":"fc2003d7817a0214acbca875fce5e8c7180251fdcd6420f465b56f31919a0f59"} Jul 09 20:08:07.058984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:07.058492 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mx5sd" event={"ID":"af2b69e0-b56f-40e1-986f-0c2acb0392f2","Type":"ContainerStarted","Data":"ae33679ee05b7e28a45fcc4b16f9649a91f60d09bb6ac9ff645e6732664ee6cc"} Jul 09 20:08:07.074143 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:07.074104 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-ng8mp" Jul 09 20:08:07.080726 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:07.079900 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mx5sd" podStartSLOduration=7.974970236 podStartE2EDuration="9.079878541s" totalImagesPullingTime="1.012243146s" totalInitContainerRuntime="92.665159ms" isStatefulPod=true podCreationTimestamp="2026-07-09 20:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:07.077675356 +0000 UTC m=+307.534812599" watchObservedRunningTime="2026-07-09 20:08:07.079878541 +0000 UTC m=+307.537015783" Jul 09 20:08:08.065311 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:08.065270 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:08.090795 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:08.090761 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:08:10.677844 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:10.677801 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:10.728587 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:10.728498 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:11.078906 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.077578 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69dbc768-ms787" event={"ID":"d29f86cb-414e-47f8-8e6f-9120009c2d0e","Type":"ContainerStarted","Data":"a5026744c9ce857ea80ff91e39cb0f3707ab08b6c405674204781f58cabe5352"} Jul 09 20:08:11.085105 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.084996 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" event={"ID":"7ed69cda-db0d-4799-a5f9-39fb4350f0e9","Type":"ContainerStarted","Data":"7dcba11cd4542d78b20b5375bece8cd4c170b559821b567b61d75991f855a951"} Jul 09 20:08:11.085105 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.085063 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:11.090058 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.090026 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" event={"ID":"bed066a7-4dc2-409d-9f42-b243382abf84","Type":"ContainerStarted","Data":"cc875d0203104571248cc9de2d64294eeaf38a5dd0091fe132b9574151ab5874"} Jul 09 20:08:11.090282 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.090262 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" event={"ID":"bed066a7-4dc2-409d-9f42-b243382abf84","Type":"ContainerStarted","Data":"58de41e52ca5dba2a6d22ecab185470e4b3af6cfd38300204c8517114c0f69cc"} Jul 09 20:08:11.090381 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.090313 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" event={"ID":"bed066a7-4dc2-409d-9f42-b243382abf84","Type":"ContainerStarted","Data":"8910d5a65c9668ddd08ddabc0fd8fe7e1ea823229cceb3f0cd4f6c2f2ec2266a"} Jul 09 20:08:11.092868 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.092162 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" Jul 09 20:08:11.093971 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.093940 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" event={"ID":"487fa520-9f5e-4f2f-a85f-edd7907fab3f","Type":"ContainerStarted","Data":"899e26d427a3902dcc864ec05c76e00c813a2f28bc557cdd9f1fe5682b70f82f"} Jul 09 20:08:11.094108 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.093998 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" event={"ID":"487fa520-9f5e-4f2f-a85f-edd7907fab3f","Type":"ContainerStarted","Data":"0d1d87ff191431609898fe6f6328e37ebae25973576bb2d475285b83c3796237"} Jul 09 20:08:11.094108 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.094027 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" event={"ID":"487fa520-9f5e-4f2f-a85f-edd7907fab3f","Type":"ContainerStarted","Data":"be4a860407830fc6c2abfe1e6865339a3fef1c802b225f92ab175ca1e7be3b7d"} Jul 09 20:08:11.096665 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.096613 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69dbc768-ms787" podStartSLOduration=4.205050986 podStartE2EDuration="9.096595503s" totalImagesPullingTime="4.891544517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:11.095851856 +0000 UTC m=+311.552989120" watchObservedRunningTime="2026-07-09 20:08:11.096595503 +0000 UTC m=+311.553732737" Jul 09 20:08:11.137251 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:11.136966 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-n4dvm" podStartSLOduration=3.245348475 podStartE2EDuration="8.136938794s" totalImagesPullingTime="4.891590319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:11.113100059 +0000 UTC m=+311.570237301" watchObservedRunningTime="2026-07-09 20:08:11.136938794 +0000 UTC m=+311.594076036" Jul 09 20:08:12.980093 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:12.980062 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:08:13.000797 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:13.000740 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-z8cbm" podStartSLOduration=10.108020522 podStartE2EDuration="15.000720022s" totalImagesPullingTime="4.8926995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:11.139087473 +0000 UTC m=+311.596224714" watchObservedRunningTime="2026-07-09 20:08:13.000720022 +0000 UTC m=+313.457857278" Jul 09 20:08:13.107613 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:13.107575 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" event={"ID":"bed066a7-4dc2-409d-9f42-b243382abf84","Type":"ContainerStarted","Data":"e675cd7e954d607d2fdcfac9339c9b82f65c8d3ff050fa2b2fd2d913292ce745"} Jul 09 20:08:13.107842 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:13.107664 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" event={"ID":"bed066a7-4dc2-409d-9f42-b243382abf84","Type":"ContainerStarted","Data":"00664b1be7cc04f44b4619852711b034ed6ca6504780599225f4d110b6cfc832"} Jul 09 20:08:13.107842 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:13.107711 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" event={"ID":"bed066a7-4dc2-409d-9f42-b243382abf84","Type":"ContainerStarted","Data":"1412a09a40d8140e094eb033873d33fb5681959352ef06934f9b9ec561727e8b"} Jul 09 20:08:13.127943 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:13.127881 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" podStartSLOduration=6.715160933 podStartE2EDuration="13.1278605s" totalImagesPullingTime="6.412699567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:08:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:13.126997854 +0000 UTC m=+313.584135091" watchObservedRunningTime="2026-07-09 20:08:13.1278605 +0000 UTC m=+313.584997741" Jul 09 20:08:13.443085 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:13.443045 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:13.547236 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:13.547192 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:14.116366 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:14.116320 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:14.360183 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:14.360145 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:14.447683 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:14.447647 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:14.499320 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:14.499278 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:15.125717 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:15.125691 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5cbf6ccfff-nbpd4" Jul 09 20:08:16.836268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:16.836214 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:16.938065 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:16.938029 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:22.835918 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:22.835872 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:22.836436 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:22.835951 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:25.904767 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:25.904731 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:25.955673 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:25.955633 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:26.604926 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:26.604889 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:26.655327 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:26.655295 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:28.003068 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.003024 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" podUID="dda0c331-3e63-4d6b-938c-6b570953e802" containerName="registry" containerID="cri-o://0780beedae0b6baa551668c15dc4e505ea92d723e100a393c77f212c5b24e133" gracePeriod=30 Jul 09 20:08:28.058479 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.058417 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79674967c4-rkrb6" podUID="d91468f5-17d9-44e9-b5c0-e195b6283d56" containerName="console" containerID="cri-o://a21724c7bd32342c6b14393c51abc643eb233297a3c5e72d80fea25e4f49b18a" gracePeriod=15 Jul 09 20:08:28.172198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.172168 2583 generic.go:356] "Generic (PLEG): container finished" podID="d91468f5-17d9-44e9-b5c0-e195b6283d56" containerID="a21724c7bd32342c6b14393c51abc643eb233297a3c5e72d80fea25e4f49b18a" exitCode=0 Jul 09 20:08:28.172382 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.172237 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79674967c4-rkrb6" event={"ID":"d91468f5-17d9-44e9-b5c0-e195b6283d56","Type":"ContainerDied","Data":"a21724c7bd32342c6b14393c51abc643eb233297a3c5e72d80fea25e4f49b18a"} Jul 09 20:08:28.173567 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.173545 2583 generic.go:356] "Generic (PLEG): container finished" podID="dda0c331-3e63-4d6b-938c-6b570953e802" containerID="0780beedae0b6baa551668c15dc4e505ea92d723e100a393c77f212c5b24e133" exitCode=0 Jul 09 20:08:28.173674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.173604 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" event={"ID":"dda0c331-3e63-4d6b-938c-6b570953e802","Type":"ContainerDied","Data":"0780beedae0b6baa551668c15dc4e505ea92d723e100a393c77f212c5b24e133"} Jul 09 20:08:28.338285 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.338260 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:08:28.348260 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.348236 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:08:28.370350 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370324 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-trusted-ca\") pod \"dda0c331-3e63-4d6b-938c-6b570953e802\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " Jul 09 20:08:28.370521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370364 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-oauth-serving-cert\") pod \"d91468f5-17d9-44e9-b5c0-e195b6283d56\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " Jul 09 20:08:28.370521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370391 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6lst\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-kube-api-access-f6lst\") pod \"dda0c331-3e63-4d6b-938c-6b570953e802\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " Jul 09 20:08:28.370521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370418 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-registry-certificates\") pod \"dda0c331-3e63-4d6b-938c-6b570953e802\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " Jul 09 20:08:28.370521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370436 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") pod \"dda0c331-3e63-4d6b-938c-6b570953e802\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " Jul 09 20:08:28.370521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370487 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-installation-pull-secrets\") pod \"dda0c331-3e63-4d6b-938c-6b570953e802\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370528 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-image-registry-private-configuration\") pod \"dda0c331-3e63-4d6b-938c-6b570953e802\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370565 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dda0c331-3e63-4d6b-938c-6b570953e802-ca-trust-extracted\") pod \"dda0c331-3e63-4d6b-938c-6b570953e802\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370589 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-serving-cert\") pod \"d91468f5-17d9-44e9-b5c0-e195b6283d56\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370631 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-config\") pod \"d91468f5-17d9-44e9-b5c0-e195b6283d56\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370659 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-service-ca\") pod \"d91468f5-17d9-44e9-b5c0-e195b6283d56\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370686 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-oauth-config\") pod \"d91468f5-17d9-44e9-b5c0-e195b6283d56\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370737 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-bound-sa-token\") pod \"dda0c331-3e63-4d6b-938c-6b570953e802\" (UID: \"dda0c331-3e63-4d6b-938c-6b570953e802\") " Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370738 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d91468f5-17d9-44e9-b5c0-e195b6283d56" (UID: "d91468f5-17d9-44e9-b5c0-e195b6283d56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 20:08:28.370794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370764 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfnm7\" (UniqueName: \"kubernetes.io/projected/d91468f5-17d9-44e9-b5c0-e195b6283d56-kube-api-access-bfnm7\") pod \"d91468f5-17d9-44e9-b5c0-e195b6283d56\" (UID: \"d91468f5-17d9-44e9-b5c0-e195b6283d56\") " Jul 09 20:08:28.371228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370803 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dda0c331-3e63-4d6b-938c-6b570953e802" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 20:08:28.371228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.370986 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-trusted-ca\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.371228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.371008 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-oauth-serving-cert\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.371228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.371188 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dda0c331-3e63-4d6b-938c-6b570953e802" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 20:08:28.371228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.371193 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-service-ca" (OuterVolumeSpecName: "service-ca") pod "d91468f5-17d9-44e9-b5c0-e195b6283d56" (UID: "d91468f5-17d9-44e9-b5c0-e195b6283d56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 20:08:28.372886 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.371721 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-config" (OuterVolumeSpecName: "console-config") pod "d91468f5-17d9-44e9-b5c0-e195b6283d56" (UID: "d91468f5-17d9-44e9-b5c0-e195b6283d56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 20:08:28.374144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.374087 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d91468f5-17d9-44e9-b5c0-e195b6283d56-kube-api-access-bfnm7" (OuterVolumeSpecName: "kube-api-access-bfnm7") pod "d91468f5-17d9-44e9-b5c0-e195b6283d56" (UID: "d91468f5-17d9-44e9-b5c0-e195b6283d56"). InnerVolumeSpecName "kube-api-access-bfnm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:08:28.374297 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.374260 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-kube-api-access-f6lst" (OuterVolumeSpecName: "kube-api-access-f6lst") pod "dda0c331-3e63-4d6b-938c-6b570953e802" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802"). InnerVolumeSpecName "kube-api-access-f6lst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:08:28.374426 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.374325 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dda0c331-3e63-4d6b-938c-6b570953e802" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:08:28.374637 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.374611 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d91468f5-17d9-44e9-b5c0-e195b6283d56" (UID: "d91468f5-17d9-44e9-b5c0-e195b6283d56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 20:08:28.374840 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.374808 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d91468f5-17d9-44e9-b5c0-e195b6283d56" (UID: "d91468f5-17d9-44e9-b5c0-e195b6283d56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 20:08:28.375083 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.375036 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dda0c331-3e63-4d6b-938c-6b570953e802" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 20:08:28.375531 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.375511 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dda0c331-3e63-4d6b-938c-6b570953e802" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 20:08:28.375787 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.375770 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dda0c331-3e63-4d6b-938c-6b570953e802" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:08:28.382177 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.382152 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dda0c331-3e63-4d6b-938c-6b570953e802-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dda0c331-3e63-4d6b-938c-6b570953e802" (UID: "dda0c331-3e63-4d6b-938c-6b570953e802"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:08:28.471523 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471480 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6lst\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-kube-api-access-f6lst\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471523 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471516 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dda0c331-3e63-4d6b-938c-6b570953e802-registry-certificates\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471523 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471527 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-registry-tls\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471523 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471535 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-installation-pull-secrets\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471546 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dda0c331-3e63-4d6b-938c-6b570953e802-image-registry-private-configuration\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471555 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dda0c331-3e63-4d6b-938c-6b570953e802-ca-trust-extracted\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471564 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-serving-cert\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471573 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-config\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471580 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91468f5-17d9-44e9-b5c0-e195b6283d56-service-ca\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471587 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91468f5-17d9-44e9-b5c0-e195b6283d56-console-oauth-config\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471595 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dda0c331-3e63-4d6b-938c-6b570953e802-bound-sa-token\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:28.471785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:28.471603 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfnm7\" (UniqueName: \"kubernetes.io/projected/d91468f5-17d9-44e9-b5c0-e195b6283d56-kube-api-access-bfnm7\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:08:29.178877 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.178842 2583 generic.go:356] "Generic (PLEG): container finished" podID="102309c1-eda2-40b9-81ce-6fe288b324f5" containerID="06dd3d59563a987e1c59b9c22b0e81312d7dd5f14ab60b11435f60cf4154d8c8" exitCode=0 Jul 09 20:08:29.179286 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.178927 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" event={"ID":"102309c1-eda2-40b9-81ce-6fe288b324f5","Type":"ContainerDied","Data":"06dd3d59563a987e1c59b9c22b0e81312d7dd5f14ab60b11435f60cf4154d8c8"} Jul 09 20:08:29.179286 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.179275 2583 scope.go:117] "RemoveContainer" containerID="06dd3d59563a987e1c59b9c22b0e81312d7dd5f14ab60b11435f60cf4154d8c8" Jul 09 20:08:29.180473 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.180429 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79674967c4-rkrb6" Jul 09 20:08:29.180473 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.180440 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79674967c4-rkrb6" event={"ID":"d91468f5-17d9-44e9-b5c0-e195b6283d56","Type":"ContainerDied","Data":"d4036ec53b4ae8b63124e0dc61e12976b80ac3b68430aeffc00a92d906cc8dd1"} Jul 09 20:08:29.180639 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.180512 2583 scope.go:117] "RemoveContainer" containerID="a21724c7bd32342c6b14393c51abc643eb233297a3c5e72d80fea25e4f49b18a" Jul 09 20:08:29.182039 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.182016 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" event={"ID":"dda0c331-3e63-4d6b-938c-6b570953e802","Type":"ContainerDied","Data":"b811d8902fe121d57e88893ef671effd304318c12c8e7a4f127f645ad30895cd"} Jul 09 20:08:29.182275 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.182063 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dfdccb8df-ps6bs" Jul 09 20:08:29.193192 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.193171 2583 scope.go:117] "RemoveContainer" containerID="0780beedae0b6baa551668c15dc4e505ea92d723e100a393c77f212c5b24e133" Jul 09 20:08:29.214063 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.214029 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dfdccb8df-ps6bs"] Jul 09 20:08:29.220642 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.220613 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dfdccb8df-ps6bs"] Jul 09 20:08:29.232487 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.232438 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79674967c4-rkrb6"] Jul 09 20:08:29.239089 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:29.239058 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79674967c4-rkrb6"] Jul 09 20:08:30.094630 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:30.094595 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d91468f5-17d9-44e9-b5c0-e195b6283d56" path="/var/lib/kubelet/pods/d91468f5-17d9-44e9-b5c0-e195b6283d56/volumes" Jul 09 20:08:30.095018 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:30.095005 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda0c331-3e63-4d6b-938c-6b570953e802" path="/var/lib/kubelet/pods/dda0c331-3e63-4d6b-938c-6b570953e802/volumes" Jul 09 20:08:30.188658 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:30.188622 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6b4ds" event={"ID":"102309c1-eda2-40b9-81ce-6fe288b324f5","Type":"ContainerStarted","Data":"e4c752def2fe9e248253b3e1915e33c34f51252eb3a53456fd61144727466d80"} Jul 09 20:08:36.316016 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:36.315978 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:39.590682 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:39.590629 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:39.638947 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:39.638903 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:42.840771 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:42.840741 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:42.844628 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:42.844607 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69dbc768-ms787" Jul 09 20:08:45.315620 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:45.315576 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:45.413658 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:45.413602 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:50.366637 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:50.366601 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:50.414692 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:50.414655 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:55.907747 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:55.907637 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:08:59.741523 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:08:59.741471 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:14.068543 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:14.068482 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:09:14.070938 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:14.070916 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1367c363-01b3-4c1e-bc94-5e8bd1afef16-metrics-certs\") pod \"network-metrics-daemon-k9bkk\" (UID: \"1367c363-01b3-4c1e-bc94-5e8bd1afef16\") " pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:09:14.094488 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:14.094436 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s29qd\"" Jul 09 20:09:14.102663 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:14.102644 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k9bkk" Jul 09 20:09:14.233279 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:14.233244 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k9bkk"] Jul 09 20:09:14.237016 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:09:14.236984 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1367c363_01b3_4c1e_bc94_5e8bd1afef16.slice/crio-c72a4906de72af5548f069aad4d7832465261709eacfeac9698203df37119e78 WatchSource:0}: Error finding container c72a4906de72af5548f069aad4d7832465261709eacfeac9698203df37119e78: Status 404 returned error can't find the container with id c72a4906de72af5548f069aad4d7832465261709eacfeac9698203df37119e78 Jul 09 20:09:14.358568 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:14.358475 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k9bkk" event={"ID":"1367c363-01b3-4c1e-bc94-5e8bd1afef16","Type":"ContainerStarted","Data":"c72a4906de72af5548f069aad4d7832465261709eacfeac9698203df37119e78"} Jul 09 20:09:16.368345 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:16.368302 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k9bkk" event={"ID":"1367c363-01b3-4c1e-bc94-5e8bd1afef16","Type":"ContainerStarted","Data":"8449af5c6568b4d2bdf77603b0c437cd4f17df800e10b34cd5232ce9d2e9bc33"} Jul 09 20:09:16.368775 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:16.368372 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k9bkk" event={"ID":"1367c363-01b3-4c1e-bc94-5e8bd1afef16","Type":"ContainerStarted","Data":"141ba2f170ab243cdbde6f4389dd543b9cabe5fb176f77cd29c21db52aa40dbe"} Jul 09 20:09:16.383669 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:16.383608 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k9bkk" podStartSLOduration=374.138711214 podStartE2EDuration="6m15.383587614s" totalImagesPullingTime="1.2448764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:09:16.382172735 +0000 UTC m=+376.839309974" watchObservedRunningTime="2026-07-09 20:09:16.383587614 +0000 UTC m=+376.840724857" Jul 09 20:09:16.463599 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:16.463560 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:16.518091 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:16.518057 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:17.392276 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:17.390904 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:17.849846 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:17.849745 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:22.483058 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.483019 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw"] Jul 09 20:09:22.484026 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.483979 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda0c331-3e63-4d6b-938c-6b570953e802" containerName="registry" Jul 09 20:09:22.484026 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.484023 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda0c331-3e63-4d6b-938c-6b570953e802" containerName="registry" Jul 09 20:09:22.484205 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.484048 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91468f5-17d9-44e9-b5c0-e195b6283d56" containerName="console" Jul 09 20:09:22.484205 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.484058 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91468f5-17d9-44e9-b5c0-e195b6283d56" containerName="console" Jul 09 20:09:22.484205 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.484130 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dda0c331-3e63-4d6b-938c-6b570953e802" containerName="registry" Jul 09 20:09:22.484205 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.484140 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91468f5-17d9-44e9-b5c0-e195b6283d56" containerName="console" Jul 09 20:09:22.486564 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.486539 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.489505 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.489475 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 20:09:22.489649 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.489523 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8zjf6\"" Jul 09 20:09:22.489649 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.489558 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 20:09:22.489830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.489806 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 20:09:22.489830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.489824 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 20:09:22.490015 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.489890 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 20:09:22.496089 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.496068 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 20:09:22.499422 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.499398 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw"] Jul 09 20:09:22.536074 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.536038 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.536074 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.536073 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.536304 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.536109 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-federate-client-tls\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.536304 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.536143 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-metrics-client-ca\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.536304 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.536158 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xssjk\" (UniqueName: \"kubernetes.io/projected/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-kube-api-access-xssjk\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.536304 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.536178 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-serving-certs-ca-bundle\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.536304 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.536231 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-secret-telemeter-client\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.536304 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.536272 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-telemeter-client-tls\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.636932 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.636884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.636932 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.636925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.637132 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637069 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-federate-client-tls\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.637132 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637111 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-metrics-client-ca\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.637213 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xssjk\" (UniqueName: \"kubernetes.io/projected/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-kube-api-access-xssjk\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.637213 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637163 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-serving-certs-ca-bundle\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.637298 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637256 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-secret-telemeter-client\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.637346 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637308 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-telemeter-client-tls\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.637849 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637822 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-metrics-client-ca\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.637849 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637839 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-serving-certs-ca-bundle\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.638037 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.637929 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.639695 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.639668 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-federate-client-tls\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.639695 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.639688 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.639956 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.639939 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-telemeter-client-tls\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.640102 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.640087 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-secret-telemeter-client\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.645257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.645234 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xssjk\" (UniqueName: \"kubernetes.io/projected/9fe03ae0-49e9-411c-93e3-558e91d6fb7d-kube-api-access-xssjk\") pod \"telemeter-client-5bfc47d95d-bg6vw\" (UID: \"9fe03ae0-49e9-411c-93e3-558e91d6fb7d\") " pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.798586 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.798477 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" Jul 09 20:09:22.943950 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:22.943924 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw"] Jul 09 20:09:22.945431 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:09:22.945403 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe03ae0_49e9_411c_93e3_558e91d6fb7d.slice/crio-7239d1f77e0b28db6064e967fc365f323f3dcfd97c7224259eea96dd2f912a18 WatchSource:0}: Error finding container 7239d1f77e0b28db6064e967fc365f323f3dcfd97c7224259eea96dd2f912a18: Status 404 returned error can't find the container with id 7239d1f77e0b28db6064e967fc365f323f3dcfd97c7224259eea96dd2f912a18 Jul 09 20:09:23.397377 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:23.397341 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" event={"ID":"9fe03ae0-49e9-411c-93e3-558e91d6fb7d","Type":"ContainerStarted","Data":"7239d1f77e0b28db6064e967fc365f323f3dcfd97c7224259eea96dd2f912a18"} Jul 09 20:09:25.407545 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:25.407499 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" event={"ID":"9fe03ae0-49e9-411c-93e3-558e91d6fb7d","Type":"ContainerStarted","Data":"678330274ad4257f7990687a40357b40494ce21dfd15332bb11b5713e1ed93da"} Jul 09 20:09:27.420244 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:27.420204 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" event={"ID":"9fe03ae0-49e9-411c-93e3-558e91d6fb7d","Type":"ContainerStarted","Data":"3cdbe22bc5ff8c939c717bf6f49d8e9731324be42cec60dd42bb1e3970534098"} Jul 09 20:09:27.420762 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:27.420271 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" event={"ID":"9fe03ae0-49e9-411c-93e3-558e91d6fb7d","Type":"ContainerStarted","Data":"653fd0321b87cbc5006c1d5656dfa8a03151d208548e7a9ea9e6225c5f1d4dc4"} Jul 09 20:09:27.443539 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:27.443483 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bfc47d95d-bg6vw" podStartSLOduration=2.098761187 podStartE2EDuration="5.443464919s" totalImagesPullingTime="3.344703732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:09:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:09:27.440911426 +0000 UTC m=+387.898048678" watchObservedRunningTime="2026-07-09 20:09:27.443464919 +0000 UTC m=+387.900602150" Jul 09 20:09:28.174649 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:28.174611 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:28.229655 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:28.229632 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:32.618634 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:32.618602 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:32.667015 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:32.666978 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:37.214907 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.214870 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f8dc7985-7fcrl"] Jul 09 20:09:37.217139 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.217121 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.220031 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.220004 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 20:09:37.220179 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.220037 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 20:09:37.220179 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.220075 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 20:09:37.220179 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.220107 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 20:09:37.220179 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.220174 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-twwfz\"" Jul 09 20:09:37.220399 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.220181 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 20:09:37.224967 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.224947 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 20:09:37.230602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.230575 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f8dc7985-7fcrl"] Jul 09 20:09:37.362713 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.362662 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-oauth-serving-cert\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.362713 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.362711 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md56w\" (UniqueName: \"kubernetes.io/projected/ec8fac30-8639-4449-8707-a3be6e892491-kube-api-access-md56w\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.362936 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.362775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-service-ca\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.362936 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.362849 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-trusted-ca-bundle\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.362936 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.362890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec8fac30-8639-4449-8707-a3be6e892491-console-oauth-config\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.362936 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.362918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec8fac30-8639-4449-8707-a3be6e892491-console-serving-cert\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.363058 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.362971 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-console-config\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.463731 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.463680 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec8fac30-8639-4449-8707-a3be6e892491-console-oauth-config\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.463731 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.463731 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec8fac30-8639-4449-8707-a3be6e892491-console-serving-cert\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.463976 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.463790 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-console-config\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.463976 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.463827 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-oauth-serving-cert\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.463976 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.463845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md56w\" (UniqueName: \"kubernetes.io/projected/ec8fac30-8639-4449-8707-a3be6e892491-kube-api-access-md56w\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.463976 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.463870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-service-ca\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.463976 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.463911 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-trusted-ca-bundle\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.464693 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.464655 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-oauth-serving-cert\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.464839 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.464785 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-console-config\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.464938 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.464860 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-trusted-ca-bundle\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.464938 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.464864 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec8fac30-8639-4449-8707-a3be6e892491-service-ca\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.466387 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.466360 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec8fac30-8639-4449-8707-a3be6e892491-console-serving-cert\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.466524 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.466396 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec8fac30-8639-4449-8707-a3be6e892491-console-oauth-config\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.472381 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.472355 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md56w\" (UniqueName: \"kubernetes.io/projected/ec8fac30-8639-4449-8707-a3be6e892491-kube-api-access-md56w\") pod \"console-59f8dc7985-7fcrl\" (UID: \"ec8fac30-8639-4449-8707-a3be6e892491\") " pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.527526 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.527479 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:37.574246 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.574206 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:37.664601 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:37.664552 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f8dc7985-7fcrl"] Jul 09 20:09:37.668339 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:09:37.668297 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8fac30_8639_4449_8707_a3be6e892491.slice/crio-3726a3a13b5a1c1574481e0f7eac85a0df9991bd36a159985ab39528b19ab9cf WatchSource:0}: Error finding container 3726a3a13b5a1c1574481e0f7eac85a0df9991bd36a159985ab39528b19ab9cf: Status 404 returned error can't find the container with id 3726a3a13b5a1c1574481e0f7eac85a0df9991bd36a159985ab39528b19ab9cf Jul 09 20:09:38.171740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:38.171705 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:38.220579 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:38.220547 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:38.462996 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:38.462906 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8dc7985-7fcrl" event={"ID":"ec8fac30-8639-4449-8707-a3be6e892491","Type":"ContainerStarted","Data":"6c6d6e50cb7b9290f80da3eeb9119385a27f8aff9f10c9894dfc35ec57d2ae55"} Jul 09 20:09:38.462996 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:38.462961 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f8dc7985-7fcrl" event={"ID":"ec8fac30-8639-4449-8707-a3be6e892491","Type":"ContainerStarted","Data":"3726a3a13b5a1c1574481e0f7eac85a0df9991bd36a159985ab39528b19ab9cf"} Jul 09 20:09:38.480758 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:38.480711 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f8dc7985-7fcrl" podStartSLOduration=1.480693995 podStartE2EDuration="1.480693995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:09:38.480009061 +0000 UTC m=+398.937146302" watchObservedRunningTime="2026-07-09 20:09:38.480693995 +0000 UTC m=+398.937831234" Jul 09 20:09:44.556259 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:44.556227 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:44.607323 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:44.607285 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:47.528475 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:47.528410 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:47.528939 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:47.528501 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:47.533355 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:47.533321 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:48.503227 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:48.503198 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f8dc7985-7fcrl" Jul 09 20:09:48.649029 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:48.648999 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:48.709183 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:48.709150 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:48.759748 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:48.759661 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:56.608944 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:56.608907 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:56.709532 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:56.709492 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:56.760979 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:56.760947 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:58.012414 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:58.012379 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:09:58.109131 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:09:58.109101 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:22.897370 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:22.897288 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:22.988769 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:22.988730 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:23.515828 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.515796 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw"] Jul 09 20:10:23.522889 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.522854 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.526306 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.526278 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2qxkc\"" Jul 09 20:10:23.526490 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.526309 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 20:10:23.526490 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.526338 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 20:10:23.527034 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.527005 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw"] Jul 09 20:10:23.547015 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.546984 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7n92\" (UniqueName: \"kubernetes.io/projected/3d91f068-b06b-419c-8161-128e721a15c8-kube-api-access-q7n92\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.547015 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.547017 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.547188 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.547045 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.648438 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.648398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7n92\" (UniqueName: \"kubernetes.io/projected/3d91f068-b06b-419c-8161-128e721a15c8-kube-api-access-q7n92\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.648623 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.648440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.648623 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.648512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.648796 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.648779 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.648846 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.648828 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.656840 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.656815 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7n92\" (UniqueName: \"kubernetes.io/projected/3d91f068-b06b-419c-8161-128e721a15c8-kube-api-access-q7n92\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.833765 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.833678 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:23.963927 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:23.963772 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw"] Jul 09 20:10:23.966648 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:10:23.966622 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d91f068_b06b_419c_8161_128e721a15c8.slice/crio-3a9ef768fd7b393bc7bdb4be530d24fdd7cc5dbe6569af841c06fb1a0469a84e WatchSource:0}: Error finding container 3a9ef768fd7b393bc7bdb4be530d24fdd7cc5dbe6569af841c06fb1a0469a84e: Status 404 returned error can't find the container with id 3a9ef768fd7b393bc7bdb4be530d24fdd7cc5dbe6569af841c06fb1a0469a84e Jul 09 20:10:24.640253 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:24.640216 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" event={"ID":"3d91f068-b06b-419c-8161-128e721a15c8","Type":"ContainerStarted","Data":"3a9ef768fd7b393bc7bdb4be530d24fdd7cc5dbe6569af841c06fb1a0469a84e"} Jul 09 20:10:26.049642 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:26.049600 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:33.679725 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:33.679688 2583 generic.go:356] "Generic (PLEG): container finished" podID="3d91f068-b06b-419c-8161-128e721a15c8" containerID="114ce234faac070fbdd36a3893b1c5c05ee43e25b6000335ee80baa56c340b29" exitCode=0 Jul 09 20:10:33.680116 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:33.679738 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" event={"ID":"3d91f068-b06b-419c-8161-128e721a15c8","Type":"ContainerDied","Data":"114ce234faac070fbdd36a3893b1c5c05ee43e25b6000335ee80baa56c340b29"} Jul 09 20:10:37.696516 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:37.696397 2583 generic.go:356] "Generic (PLEG): container finished" podID="3d91f068-b06b-419c-8161-128e721a15c8" containerID="6700d29e000ccb6a701f1f224ccc91799c7b3d3ad2430ee49258cbde2ff61508" exitCode=0 Jul 09 20:10:37.696516 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:37.696484 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" event={"ID":"3d91f068-b06b-419c-8161-128e721a15c8","Type":"ContainerDied","Data":"6700d29e000ccb6a701f1f224ccc91799c7b3d3ad2430ee49258cbde2ff61508"} Jul 09 20:10:39.561117 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.561076 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6"] Jul 09 20:10:39.564764 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.564748 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" Jul 09 20:10:39.567188 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.567161 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 20:10:39.567383 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.567361 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lfzk9\"" Jul 09 20:10:39.567532 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.567511 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 20:10:39.568633 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.568611 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 20:10:39.568734 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.568637 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 20:10:39.571763 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.571740 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6"] Jul 09 20:10:39.573973 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.573929 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:39.661520 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.661486 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:39.687795 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.687767 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6\" (UID: \"ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" Jul 09 20:10:39.687964 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.687807 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77mml\" (UniqueName: \"kubernetes.io/projected/ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec-kube-api-access-77mml\") pod \"managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6\" (UID: \"ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" Jul 09 20:10:39.717842 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.717810 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:39.764876 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.764836 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r"] Jul 09 20:10:39.769109 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.769085 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.771767 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.771745 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 09 20:10:39.779344 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.779319 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r"] Jul 09 20:10:39.788429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.788400 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6\" (UID: \"ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" Jul 09 20:10:39.788584 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.788477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77mml\" (UniqueName: \"kubernetes.io/projected/ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec-kube-api-access-77mml\") pod \"managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6\" (UID: \"ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" Jul 09 20:10:39.791481 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.791406 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6\" (UID: \"ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" Jul 09 20:10:39.797507 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.797484 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77mml\" (UniqueName: \"kubernetes.io/projected/ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec-kube-api-access-77mml\") pod \"managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6\" (UID: \"ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" Jul 09 20:10:39.888017 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.887993 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" Jul 09 20:10:39.889255 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.889234 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0943336b-36c9-4d53-bdec-feb47ee7be15-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.889318 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.889285 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0943336b-36c9-4d53-bdec-feb47ee7be15-tmp\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.889375 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.889355 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgl5x\" (UniqueName: \"kubernetes.io/projected/0943336b-36c9-4d53-bdec-feb47ee7be15-kube-api-access-lgl5x\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.990078 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.990035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0943336b-36c9-4d53-bdec-feb47ee7be15-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.990254 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.990131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0943336b-36c9-4d53-bdec-feb47ee7be15-tmp\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.990254 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.990192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgl5x\" (UniqueName: \"kubernetes.io/projected/0943336b-36c9-4d53-bdec-feb47ee7be15-kube-api-access-lgl5x\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.990908 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.990879 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0943336b-36c9-4d53-bdec-feb47ee7be15-tmp\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.994406 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.993608 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0943336b-36c9-4d53-bdec-feb47ee7be15-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:39.999391 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:39.999359 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgl5x\" (UniqueName: \"kubernetes.io/projected/0943336b-36c9-4d53-bdec-feb47ee7be15-kube-api-access-lgl5x\") pod \"klusterlet-addon-workmgr-7d866b8678-hkx8r\" (UID: \"0943336b-36c9-4d53-bdec-feb47ee7be15\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:40.032225 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:40.032156 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6"] Jul 09 20:10:40.034882 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:10:40.034851 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad1bd3b7_d3ab_43b5_b0f5_2f2a211d2bec.slice/crio-43e7f6be49885121a217f8150a743d57ca12ecd743bc64b67987df48e2dba767 WatchSource:0}: Error finding container 43e7f6be49885121a217f8150a743d57ca12ecd743bc64b67987df48e2dba767: Status 404 returned error can't find the container with id 43e7f6be49885121a217f8150a743d57ca12ecd743bc64b67987df48e2dba767 Jul 09 20:10:40.081442 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:40.081407 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:40.234090 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:40.234051 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r"] Jul 09 20:10:40.237358 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:10:40.237323 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0943336b_36c9_4d53_bdec_feb47ee7be15.slice/crio-0fef964f3768a948a87f34ad4af66869dd300f0493a9c0bc8916244d7811615f WatchSource:0}: Error finding container 0fef964f3768a948a87f34ad4af66869dd300f0493a9c0bc8916244d7811615f: Status 404 returned error can't find the container with id 0fef964f3768a948a87f34ad4af66869dd300f0493a9c0bc8916244d7811615f Jul 09 20:10:40.709049 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:40.709012 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" event={"ID":"0943336b-36c9-4d53-bdec-feb47ee7be15","Type":"ContainerStarted","Data":"0fef964f3768a948a87f34ad4af66869dd300f0493a9c0bc8916244d7811615f"} Jul 09 20:10:40.710184 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:40.710157 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" event={"ID":"ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec","Type":"ContainerStarted","Data":"43e7f6be49885121a217f8150a743d57ca12ecd743bc64b67987df48e2dba767"} Jul 09 20:10:43.727808 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:43.727695 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" event={"ID":"ad1bd3b7-d3ab-43b5-b0f5-2f2a211d2bec","Type":"ContainerStarted","Data":"052c10c357612bb8c4bb2862c168297e52a2bfd3c1d0cf49c10dd5b775d9eb82"} Jul 09 20:10:43.743932 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:43.743814 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb9b45f6b-tpzg6" podStartSLOduration=1.576471036 podStartE2EDuration="4.743796185s" totalImagesPullingTime="3.167325149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:10:43.742313811 +0000 UTC m=+464.199451052" watchObservedRunningTime="2026-07-09 20:10:43.743796185 +0000 UTC m=+464.200933426" Jul 09 20:10:45.739973 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:45.739926 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" event={"ID":"0943336b-36c9-4d53-bdec-feb47ee7be15","Type":"ContainerStarted","Data":"7b302a5fb8ae182c742a85dd02ddf623932d406f4087e8c3c6bbe8a7ee3dfda1"} Jul 09 20:10:45.740530 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:45.740107 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:45.742057 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:45.742033 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" Jul 09 20:10:45.756779 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:45.756716 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d866b8678-hkx8r" podStartSLOduration=1.844655017 podStartE2EDuration="6.756695778s" totalImagesPullingTime="4.912040761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:10:45.755062389 +0000 UTC m=+466.212199633" watchObservedRunningTime="2026-07-09 20:10:45.756695778 +0000 UTC m=+466.213833017" Jul 09 20:10:48.755820 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:48.755785 2583 generic.go:356] "Generic (PLEG): container finished" podID="3d91f068-b06b-419c-8161-128e721a15c8" containerID="7571e46ea11044973c4437ad1ccec13d96aac701b5e5d57f971e5cc4965c5829" exitCode=0 Jul 09 20:10:48.756195 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:48.755866 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" event={"ID":"3d91f068-b06b-419c-8161-128e721a15c8","Type":"ContainerDied","Data":"7571e46ea11044973c4437ad1ccec13d96aac701b5e5d57f971e5cc4965c5829"} Jul 09 20:10:49.886351 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:49.886330 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:49.981496 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:49.981432 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7n92\" (UniqueName: \"kubernetes.io/projected/3d91f068-b06b-419c-8161-128e721a15c8-kube-api-access-q7n92\") pod \"3d91f068-b06b-419c-8161-128e721a15c8\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " Jul 09 20:10:49.981689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:49.981551 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-bundle\") pod \"3d91f068-b06b-419c-8161-128e721a15c8\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " Jul 09 20:10:49.981689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:49.981596 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-util\") pod \"3d91f068-b06b-419c-8161-128e721a15c8\" (UID: \"3d91f068-b06b-419c-8161-128e721a15c8\") " Jul 09 20:10:49.982294 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:49.982209 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-bundle" (OuterVolumeSpecName: "bundle") pod "3d91f068-b06b-419c-8161-128e721a15c8" (UID: "3d91f068-b06b-419c-8161-128e721a15c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:10:49.983790 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:49.983767 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d91f068-b06b-419c-8161-128e721a15c8-kube-api-access-q7n92" (OuterVolumeSpecName: "kube-api-access-q7n92") pod "3d91f068-b06b-419c-8161-128e721a15c8" (UID: "3d91f068-b06b-419c-8161-128e721a15c8"). InnerVolumeSpecName "kube-api-access-q7n92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:10:49.986507 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:49.986483 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-util" (OuterVolumeSpecName: "util") pod "3d91f068-b06b-419c-8161-128e721a15c8" (UID: "3d91f068-b06b-419c-8161-128e721a15c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:10:50.082311 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:50.082213 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:10:50.082311 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:50.082237 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d91f068-b06b-419c-8161-128e721a15c8-util\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:10:50.082311 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:50.082250 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7n92\" (UniqueName: \"kubernetes.io/projected/3d91f068-b06b-419c-8161-128e721a15c8-kube-api-access-q7n92\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:10:50.765182 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:50.765148 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" event={"ID":"3d91f068-b06b-419c-8161-128e721a15c8","Type":"ContainerDied","Data":"3a9ef768fd7b393bc7bdb4be530d24fdd7cc5dbe6569af841c06fb1a0469a84e"} Jul 09 20:10:50.765359 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:50.765196 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a9ef768fd7b393bc7bdb4be530d24fdd7cc5dbe6569af841c06fb1a0469a84e" Jul 09 20:10:50.765359 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:50.765159 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540crctw" Jul 09 20:10:54.713823 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:54.713785 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:55.540398 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:55.540358 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:56.500098 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.500054 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8"] Jul 09 20:10:56.500626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.500441 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d91f068-b06b-419c-8161-128e721a15c8" containerName="pull" Jul 09 20:10:56.500626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.500469 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d91f068-b06b-419c-8161-128e721a15c8" containerName="pull" Jul 09 20:10:56.500626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.500493 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d91f068-b06b-419c-8161-128e721a15c8" containerName="util" Jul 09 20:10:56.500626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.500502 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d91f068-b06b-419c-8161-128e721a15c8" containerName="util" Jul 09 20:10:56.500626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.500515 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d91f068-b06b-419c-8161-128e721a15c8" containerName="extract" Jul 09 20:10:56.500626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.500521 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d91f068-b06b-419c-8161-128e721a15c8" containerName="extract" Jul 09 20:10:56.500626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.500575 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d91f068-b06b-419c-8161-128e721a15c8" containerName="extract" Jul 09 20:10:56.503506 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.503490 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" Jul 09 20:10:56.506180 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.506130 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 20:10:56.506180 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.506174 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qxwkn\"" Jul 09 20:10:56.506383 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.506270 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 20:10:56.515347 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.515324 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8"] Jul 09 20:10:56.640940 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.640903 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmlzp\" (UniqueName: \"kubernetes.io/projected/21867493-cffc-45eb-a05e-d023e0d76500-kube-api-access-gmlzp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lrlj8\" (UID: \"21867493-cffc-45eb-a05e-d023e0d76500\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" Jul 09 20:10:56.641126 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.640982 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21867493-cffc-45eb-a05e-d023e0d76500-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lrlj8\" (UID: \"21867493-cffc-45eb-a05e-d023e0d76500\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" Jul 09 20:10:56.742257 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.742203 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmlzp\" (UniqueName: \"kubernetes.io/projected/21867493-cffc-45eb-a05e-d023e0d76500-kube-api-access-gmlzp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lrlj8\" (UID: \"21867493-cffc-45eb-a05e-d023e0d76500\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" Jul 09 20:10:56.742400 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.742299 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21867493-cffc-45eb-a05e-d023e0d76500-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lrlj8\" (UID: \"21867493-cffc-45eb-a05e-d023e0d76500\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" Jul 09 20:10:56.742681 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.742665 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21867493-cffc-45eb-a05e-d023e0d76500-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lrlj8\" (UID: \"21867493-cffc-45eb-a05e-d023e0d76500\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" Jul 09 20:10:56.750853 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.750793 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmlzp\" (UniqueName: \"kubernetes.io/projected/21867493-cffc-45eb-a05e-d023e0d76500-kube-api-access-gmlzp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lrlj8\" (UID: \"21867493-cffc-45eb-a05e-d023e0d76500\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" Jul 09 20:10:56.813218 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.813167 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" Jul 09 20:10:56.955363 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:56.955335 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8"] Jul 09 20:10:56.958183 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:10:56.958159 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21867493_cffc_45eb_a05e_d023e0d76500.slice/crio-a9ba90755ee9969a652747b43a5242ecd9db245def1abefc56b3e69919f616c5 WatchSource:0}: Error finding container a9ba90755ee9969a652747b43a5242ecd9db245def1abefc56b3e69919f616c5: Status 404 returned error can't find the container with id a9ba90755ee9969a652747b43a5242ecd9db245def1abefc56b3e69919f616c5 Jul 09 20:10:57.795946 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:57.795911 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" event={"ID":"21867493-cffc-45eb-a05e-d023e0d76500","Type":"ContainerStarted","Data":"a9ba90755ee9969a652747b43a5242ecd9db245def1abefc56b3e69919f616c5"} Jul 09 20:10:58.166239 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:58.166198 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:58.269354 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:58.269323 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:10:59.806629 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:59.806595 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" event={"ID":"21867493-cffc-45eb-a05e-d023e0d76500","Type":"ContainerStarted","Data":"6a8b3da10510d783881e9e96e708ebc8536135d37c399193c12909ea3406bffc"} Jul 09 20:10:59.827937 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:10:59.827876 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lrlj8" podStartSLOduration=1.429466027 podStartE2EDuration="3.827854372s" totalImagesPullingTime="2.398388345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:10:59.826332174 +0000 UTC m=+480.283469417" watchObservedRunningTime="2026-07-09 20:10:59.827854372 +0000 UTC m=+480.284991615" Jul 09 20:11:00.083890 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.083795 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:00.191882 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.191845 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:00.341206 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.341116 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:00.387820 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.387787 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mhfrs"] Jul 09 20:11:00.391271 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.391242 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:00.395207 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.395183 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 20:11:00.395351 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.395184 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4hjz7\"" Jul 09 20:11:00.395351 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.395183 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 20:11:00.404837 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.404809 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mhfrs"] Jul 09 20:11:00.474573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.474529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0105041-e6f9-4cc7-87c0-b92e0920f324-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mhfrs\" (UID: \"f0105041-e6f9-4cc7-87c0-b92e0920f324\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:00.474753 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.474588 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s57fq\" (UniqueName: \"kubernetes.io/projected/f0105041-e6f9-4cc7-87c0-b92e0920f324-kube-api-access-s57fq\") pod \"cert-manager-webhook-6486ffd997-mhfrs\" (UID: \"f0105041-e6f9-4cc7-87c0-b92e0920f324\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:00.575255 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.575220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s57fq\" (UniqueName: \"kubernetes.io/projected/f0105041-e6f9-4cc7-87c0-b92e0920f324-kube-api-access-s57fq\") pod \"cert-manager-webhook-6486ffd997-mhfrs\" (UID: \"f0105041-e6f9-4cc7-87c0-b92e0920f324\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:00.575407 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.575317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0105041-e6f9-4cc7-87c0-b92e0920f324-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mhfrs\" (UID: \"f0105041-e6f9-4cc7-87c0-b92e0920f324\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:00.584394 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.584351 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0105041-e6f9-4cc7-87c0-b92e0920f324-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mhfrs\" (UID: \"f0105041-e6f9-4cc7-87c0-b92e0920f324\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:00.584588 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.584551 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s57fq\" (UniqueName: \"kubernetes.io/projected/f0105041-e6f9-4cc7-87c0-b92e0920f324-kube-api-access-s57fq\") pod \"cert-manager-webhook-6486ffd997-mhfrs\" (UID: \"f0105041-e6f9-4cc7-87c0-b92e0920f324\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:00.701565 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.701513 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:00.846626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:00.846591 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mhfrs"] Jul 09 20:11:00.850009 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:11:00.849969 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0105041_e6f9_4cc7_87c0_b92e0920f324.slice/crio-54afa027bf7449ac26b45f0d38bd083a9be396d9b2bb77e738b272a137276800 WatchSource:0}: Error finding container 54afa027bf7449ac26b45f0d38bd083a9be396d9b2bb77e738b272a137276800: Status 404 returned error can't find the container with id 54afa027bf7449ac26b45f0d38bd083a9be396d9b2bb77e738b272a137276800 Jul 09 20:11:01.005499 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.005386 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l"] Jul 09 20:11:01.010011 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.009988 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.012699 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.012674 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2qxkc\"" Jul 09 20:11:01.012830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.012715 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 20:11:01.012830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.012737 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 20:11:01.020504 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.020480 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l"] Jul 09 20:11:01.180912 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.180870 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qddkh\" (UniqueName: \"kubernetes.io/projected/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-kube-api-access-qddkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.181108 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.180928 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.181108 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.181055 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.282027 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.281947 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.282027 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.281994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qddkh\" (UniqueName: \"kubernetes.io/projected/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-kube-api-access-qddkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.282027 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.282028 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.282405 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.282390 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.282469 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.282391 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.290303 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.290282 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qddkh\" (UniqueName: \"kubernetes.io/projected/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-kube-api-access-qddkh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.321323 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.321288 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:01.457981 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.457947 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l"] Jul 09 20:11:01.461479 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:11:01.461428 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb29929d_aa18_4f5c_a0e2_e73530dfa4b1.slice/crio-edbb7e65373d0c4fe3454a62bb886dec9d10c99cd05fa80d46e023342596a46b WatchSource:0}: Error finding container edbb7e65373d0c4fe3454a62bb886dec9d10c99cd05fa80d46e023342596a46b: Status 404 returned error can't find the container with id edbb7e65373d0c4fe3454a62bb886dec9d10c99cd05fa80d46e023342596a46b Jul 09 20:11:01.819413 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.819322 2583 generic.go:356] "Generic (PLEG): container finished" podID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerID="28cfcb6c5cbddcffb06af87add070b8c38cbf4c8afed037b3f3488d79c312cb1" exitCode=0 Jul 09 20:11:01.819413 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.819399 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" event={"ID":"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1","Type":"ContainerDied","Data":"28cfcb6c5cbddcffb06af87add070b8c38cbf4c8afed037b3f3488d79c312cb1"} Jul 09 20:11:01.819957 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.819512 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" event={"ID":"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1","Type":"ContainerStarted","Data":"edbb7e65373d0c4fe3454a62bb886dec9d10c99cd05fa80d46e023342596a46b"} Jul 09 20:11:01.820880 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:01.820853 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" event={"ID":"f0105041-e6f9-4cc7-87c0-b92e0920f324","Type":"ContainerStarted","Data":"54afa027bf7449ac26b45f0d38bd083a9be396d9b2bb77e738b272a137276800"} Jul 09 20:11:02.094863 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:02.094715 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:02.478687 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:02.478648 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:05.174077 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:05.174040 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:05.224046 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:05.224011 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:05.844320 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:05.844284 2583 generic.go:356] "Generic (PLEG): container finished" podID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerID="75e1976cc926734fb2e4442a1c0af8df7c839c748a1094aa030ed9d66795e696" exitCode=0 Jul 09 20:11:05.844547 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:05.844383 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" event={"ID":"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1","Type":"ContainerDied","Data":"75e1976cc926734fb2e4442a1c0af8df7c839c748a1094aa030ed9d66795e696"} Jul 09 20:11:05.846072 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:05.846051 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" event={"ID":"f0105041-e6f9-4cc7-87c0-b92e0920f324","Type":"ContainerStarted","Data":"9a66c118f21d88c8f0ec910f27eb7cf760c354a0a0e55d4963055d4ef3c0a220"} Jul 09 20:11:05.846155 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:05.846132 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:05.877707 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:05.877653 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" podStartSLOduration=1.9675569720000001 podStartE2EDuration="5.877635572s" totalImagesPullingTime="3.9100786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:11:05.875809372 +0000 UTC m=+486.332946613" watchObservedRunningTime="2026-07-09 20:11:05.877635572 +0000 UTC m=+486.334772811" Jul 09 20:11:06.653204 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:06.653169 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:06.701407 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:06.701380 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:06.852314 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:06.852281 2583 generic.go:356] "Generic (PLEG): container finished" podID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerID="80de8f2c1e944a203ca6b20df08d3dbe6d40a24f0d2c7a9d63b98e800966d59f" exitCode=0 Jul 09 20:11:06.852517 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:06.852378 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" event={"ID":"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1","Type":"ContainerDied","Data":"80de8f2c1e944a203ca6b20df08d3dbe6d40a24f0d2c7a9d63b98e800966d59f"} Jul 09 20:11:07.991120 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:07.991092 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:08.142408 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.142378 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-util\") pod \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " Jul 09 20:11:08.142609 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.142425 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qddkh\" (UniqueName: \"kubernetes.io/projected/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-kube-api-access-qddkh\") pod \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " Jul 09 20:11:08.142609 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.142470 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-bundle\") pod \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\" (UID: \"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1\") " Jul 09 20:11:08.142900 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.142875 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-bundle" (OuterVolumeSpecName: "bundle") pod "fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" (UID: "fb29929d-aa18-4f5c-a0e2-e73530dfa4b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:11:08.144585 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.144552 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-kube-api-access-qddkh" (OuterVolumeSpecName: "kube-api-access-qddkh") pod "fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" (UID: "fb29929d-aa18-4f5c-a0e2-e73530dfa4b1"). InnerVolumeSpecName "kube-api-access-qddkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:11:08.147365 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.147330 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-util" (OuterVolumeSpecName: "util") pod "fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" (UID: "fb29929d-aa18-4f5c-a0e2-e73530dfa4b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:11:08.244037 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.244002 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-util\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:11:08.244037 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.244032 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qddkh\" (UniqueName: \"kubernetes.io/projected/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-kube-api-access-qddkh\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:11:08.244037 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.244043 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb29929d-aa18-4f5c-a0e2-e73530dfa4b1-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:11:08.863631 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.863605 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" Jul 09 20:11:08.863818 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.863643 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftmv5l" event={"ID":"fb29929d-aa18-4f5c-a0e2-e73530dfa4b1","Type":"ContainerDied","Data":"edbb7e65373d0c4fe3454a62bb886dec9d10c99cd05fa80d46e023342596a46b"} Jul 09 20:11:08.863818 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:08.863688 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edbb7e65373d0c4fe3454a62bb886dec9d10c99cd05fa80d46e023342596a46b" Jul 09 20:11:10.090418 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:10.090377 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:11.854863 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:11.854828 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mhfrs" Jul 09 20:11:12.936138 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.936101 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-llnqb"] Jul 09 20:11:12.936560 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.936434 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerName="util" Jul 09 20:11:12.936560 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.936461 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerName="util" Jul 09 20:11:12.936560 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.936475 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerName="extract" Jul 09 20:11:12.936560 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.936483 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerName="extract" Jul 09 20:11:12.936560 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.936502 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerName="pull" Jul 09 20:11:12.936560 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.936507 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerName="pull" Jul 09 20:11:12.936736 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.936568 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb29929d-aa18-4f5c-a0e2-e73530dfa4b1" containerName="extract" Jul 09 20:11:12.941883 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.941862 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-llnqb" Jul 09 20:11:12.944298 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.944275 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4xdxs\"" Jul 09 20:11:12.947927 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.947898 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-llnqb"] Jul 09 20:11:12.978812 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.978783 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdz5j\" (UniqueName: \"kubernetes.io/projected/9a7520cf-5ffa-4d7d-a631-cc62e130690a-kube-api-access-bdz5j\") pod \"cert-manager-55b4d954d5-llnqb\" (UID: \"9a7520cf-5ffa-4d7d-a631-cc62e130690a\") " pod="cert-manager/cert-manager-55b4d954d5-llnqb" Jul 09 20:11:12.978984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:12.978834 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a7520cf-5ffa-4d7d-a631-cc62e130690a-bound-sa-token\") pod \"cert-manager-55b4d954d5-llnqb\" (UID: \"9a7520cf-5ffa-4d7d-a631-cc62e130690a\") " pod="cert-manager/cert-manager-55b4d954d5-llnqb" Jul 09 20:11:13.079718 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.079676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdz5j\" (UniqueName: \"kubernetes.io/projected/9a7520cf-5ffa-4d7d-a631-cc62e130690a-kube-api-access-bdz5j\") pod \"cert-manager-55b4d954d5-llnqb\" (UID: \"9a7520cf-5ffa-4d7d-a631-cc62e130690a\") " pod="cert-manager/cert-manager-55b4d954d5-llnqb" Jul 09 20:11:13.079926 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.079747 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a7520cf-5ffa-4d7d-a631-cc62e130690a-bound-sa-token\") pod \"cert-manager-55b4d954d5-llnqb\" (UID: \"9a7520cf-5ffa-4d7d-a631-cc62e130690a\") " pod="cert-manager/cert-manager-55b4d954d5-llnqb" Jul 09 20:11:13.088017 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.087986 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a7520cf-5ffa-4d7d-a631-cc62e130690a-bound-sa-token\") pod \"cert-manager-55b4d954d5-llnqb\" (UID: \"9a7520cf-5ffa-4d7d-a631-cc62e130690a\") " pod="cert-manager/cert-manager-55b4d954d5-llnqb" Jul 09 20:11:13.088143 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.087996 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdz5j\" (UniqueName: \"kubernetes.io/projected/9a7520cf-5ffa-4d7d-a631-cc62e130690a-kube-api-access-bdz5j\") pod \"cert-manager-55b4d954d5-llnqb\" (UID: \"9a7520cf-5ffa-4d7d-a631-cc62e130690a\") " pod="cert-manager/cert-manager-55b4d954d5-llnqb" Jul 09 20:11:13.251901 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.251797 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-llnqb" Jul 09 20:11:13.384332 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.384309 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-llnqb"] Jul 09 20:11:13.386511 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:11:13.386483 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a7520cf_5ffa_4d7d_a631_cc62e130690a.slice/crio-692ca58b22e1bcd679f0b5cc97c94a6301de81e6ce844e5c90e37ab11a968fda WatchSource:0}: Error finding container 692ca58b22e1bcd679f0b5cc97c94a6301de81e6ce844e5c90e37ab11a968fda: Status 404 returned error can't find the container with id 692ca58b22e1bcd679f0b5cc97c94a6301de81e6ce844e5c90e37ab11a968fda Jul 09 20:11:13.887837 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.887802 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-llnqb" event={"ID":"9a7520cf-5ffa-4d7d-a631-cc62e130690a","Type":"ContainerStarted","Data":"8f0c67f59e5633058bb76b4f92dd54788ecd5a77c510aec7c8097fe22be6fbe6"} Jul 09 20:11:13.887837 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.887845 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-llnqb" event={"ID":"9a7520cf-5ffa-4d7d-a631-cc62e130690a","Type":"ContainerStarted","Data":"692ca58b22e1bcd679f0b5cc97c94a6301de81e6ce844e5c90e37ab11a968fda"} Jul 09 20:11:13.903596 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:13.903544 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-llnqb" podStartSLOduration=1.903528177 podStartE2EDuration="1.903528177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:11:13.902490076 +0000 UTC m=+494.359627319" watchObservedRunningTime="2026-07-09 20:11:13.903528177 +0000 UTC m=+494.360665417" Jul 09 20:11:16.782284 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:16.782218 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:16.877285 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:16.877245 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:22.538295 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:22.538256 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:22.654092 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:22.654059 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:24.781964 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:24.781930 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:26.623762 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:26.623724 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:26.684018 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:26.683986 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:27.646219 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.646183 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt"] Jul 09 20:11:27.648674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.648654 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.651396 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.651375 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 20:11:27.652594 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.652575 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2qxkc\"" Jul 09 20:11:27.652706 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.652577 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 20:11:27.657675 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.657651 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt"] Jul 09 20:11:27.696496 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.696439 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.696675 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.696502 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.696675 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.696595 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvhs\" (UniqueName: \"kubernetes.io/projected/e63977fb-e8f2-4d81-a140-a2db2d7b9344-kube-api-access-rjvhs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.797954 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.797919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvhs\" (UniqueName: \"kubernetes.io/projected/e63977fb-e8f2-4d81-a140-a2db2d7b9344-kube-api-access-rjvhs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.798084 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.797968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.798084 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.797990 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.798375 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.798358 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.798412 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.798364 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.806627 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.806595 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvhs\" (UniqueName: \"kubernetes.io/projected/e63977fb-e8f2-4d81-a140-a2db2d7b9344-kube-api-access-rjvhs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:27.959042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:27.958938 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:28.115021 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:28.114997 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt"] Jul 09 20:11:28.117636 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:11:28.117604 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63977fb_e8f2_4d81_a140_a2db2d7b9344.slice/crio-f33a3c5435f512a7b50781f7874759f3393ff09b6bc5cf5fe7633cb14083fa8a WatchSource:0}: Error finding container f33a3c5435f512a7b50781f7874759f3393ff09b6bc5cf5fe7633cb14083fa8a: Status 404 returned error can't find the container with id f33a3c5435f512a7b50781f7874759f3393ff09b6bc5cf5fe7633cb14083fa8a Jul 09 20:11:28.958486 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:28.958436 2583 generic.go:356] "Generic (PLEG): container finished" podID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerID="0fd6edacd014a98c51a9d0322926077fb1d5cb28085b915d58b6abaecfc02c56" exitCode=0 Jul 09 20:11:28.958486 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:28.958481 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" event={"ID":"e63977fb-e8f2-4d81-a140-a2db2d7b9344","Type":"ContainerDied","Data":"0fd6edacd014a98c51a9d0322926077fb1d5cb28085b915d58b6abaecfc02c56"} Jul 09 20:11:28.958890 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:28.958537 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" event={"ID":"e63977fb-e8f2-4d81-a140-a2db2d7b9344","Type":"ContainerStarted","Data":"f33a3c5435f512a7b50781f7874759f3393ff09b6bc5cf5fe7633cb14083fa8a"} Jul 09 20:11:29.965246 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:29.965206 2583 generic.go:356] "Generic (PLEG): container finished" podID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerID="58d4611083ee36f593246f2ae30f68b9e1f4734c9813572dce3427d2ce1968d7" exitCode=0 Jul 09 20:11:29.965658 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:29.965312 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" event={"ID":"e63977fb-e8f2-4d81-a140-a2db2d7b9344","Type":"ContainerDied","Data":"58d4611083ee36f593246f2ae30f68b9e1f4734c9813572dce3427d2ce1968d7"} Jul 09 20:11:30.972250 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:30.972213 2583 generic.go:356] "Generic (PLEG): container finished" podID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerID="bc4e0308369626e707f18681a13aac252ceda056a3355b09955be58833c751db" exitCode=0 Jul 09 20:11:30.972683 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:30.972252 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" event={"ID":"e63977fb-e8f2-4d81-a140-a2db2d7b9344","Type":"ContainerDied","Data":"bc4e0308369626e707f18681a13aac252ceda056a3355b09955be58833c751db"} Jul 09 20:11:32.110185 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.110156 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:32.136094 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.136067 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjvhs\" (UniqueName: \"kubernetes.io/projected/e63977fb-e8f2-4d81-a140-a2db2d7b9344-kube-api-access-rjvhs\") pod \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " Jul 09 20:11:32.136273 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.136121 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-bundle\") pod \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " Jul 09 20:11:32.136273 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.136141 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-util\") pod \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\" (UID: \"e63977fb-e8f2-4d81-a140-a2db2d7b9344\") " Jul 09 20:11:32.137074 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.137037 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-bundle" (OuterVolumeSpecName: "bundle") pod "e63977fb-e8f2-4d81-a140-a2db2d7b9344" (UID: "e63977fb-e8f2-4d81-a140-a2db2d7b9344"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:11:32.138326 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.138299 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63977fb-e8f2-4d81-a140-a2db2d7b9344-kube-api-access-rjvhs" (OuterVolumeSpecName: "kube-api-access-rjvhs") pod "e63977fb-e8f2-4d81-a140-a2db2d7b9344" (UID: "e63977fb-e8f2-4d81-a140-a2db2d7b9344"). InnerVolumeSpecName "kube-api-access-rjvhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:11:32.142154 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.142121 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-util" (OuterVolumeSpecName: "util") pod "e63977fb-e8f2-4d81-a140-a2db2d7b9344" (UID: "e63977fb-e8f2-4d81-a140-a2db2d7b9344"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:11:32.237592 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.237491 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjvhs\" (UniqueName: \"kubernetes.io/projected/e63977fb-e8f2-4d81-a140-a2db2d7b9344-kube-api-access-rjvhs\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:11:32.237592 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.237529 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:11:32.237592 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.237541 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e63977fb-e8f2-4d81-a140-a2db2d7b9344-util\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:11:32.606129 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.606048 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:32.983242 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.983214 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" Jul 09 20:11:32.983423 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.983246 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw28pt" event={"ID":"e63977fb-e8f2-4d81-a140-a2db2d7b9344","Type":"ContainerDied","Data":"f33a3c5435f512a7b50781f7874759f3393ff09b6bc5cf5fe7633cb14083fa8a"} Jul 09 20:11:32.983423 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:32.983291 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f33a3c5435f512a7b50781f7874759f3393ff09b6bc5cf5fe7633cb14083fa8a" Jul 09 20:11:33.117555 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.117525 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:33.244676 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.244588 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj"] Jul 09 20:11:33.244999 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.244982 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerName="util" Jul 09 20:11:33.245081 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.245002 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerName="util" Jul 09 20:11:33.245081 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.245017 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerName="pull" Jul 09 20:11:33.245081 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.245024 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerName="pull" Jul 09 20:11:33.245081 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.245056 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerName="extract" Jul 09 20:11:33.245081 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.245066 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerName="extract" Jul 09 20:11:33.245313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.245139 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63977fb-e8f2-4d81-a140-a2db2d7b9344" containerName="extract" Jul 09 20:11:33.247017 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.246997 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.251330 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.251306 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 20:11:33.251633 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.251611 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 20:11:33.251633 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.251627 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 20:11:33.251841 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.251614 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 20:11:33.252602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.252572 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 20:11:33.252730 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.252714 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9l7m7\"" Jul 09 20:11:33.270728 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.270698 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj"] Jul 09 20:11:33.292897 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.292862 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:33.348103 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.348066 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0094c174-8006-40e2-9045-d37ac315323d-cert\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.348274 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.348123 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmzm\" (UniqueName: \"kubernetes.io/projected/0094c174-8006-40e2-9045-d37ac315323d-kube-api-access-7gmzm\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.348274 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.348213 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0094c174-8006-40e2-9045-d37ac315323d-manager-config\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.348274 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.348251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0094c174-8006-40e2-9045-d37ac315323d-metrics-cert\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.448932 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.448895 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0094c174-8006-40e2-9045-d37ac315323d-cert\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.449103 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.448949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmzm\" (UniqueName: \"kubernetes.io/projected/0094c174-8006-40e2-9045-d37ac315323d-kube-api-access-7gmzm\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.449103 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.448986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0094c174-8006-40e2-9045-d37ac315323d-manager-config\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.449103 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.449002 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0094c174-8006-40e2-9045-d37ac315323d-metrics-cert\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.449729 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.449711 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0094c174-8006-40e2-9045-d37ac315323d-manager-config\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.451579 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.451549 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0094c174-8006-40e2-9045-d37ac315323d-cert\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.451664 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.451585 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0094c174-8006-40e2-9045-d37ac315323d-metrics-cert\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.465741 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.465714 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmzm\" (UniqueName: \"kubernetes.io/projected/0094c174-8006-40e2-9045-d37ac315323d-kube-api-access-7gmzm\") pod \"lws-controller-manager-5fd67cd5cb-k9wlj\" (UID: \"0094c174-8006-40e2-9045-d37ac315323d\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.557774 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.557684 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:33.701772 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.701744 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj"] Jul 09 20:11:33.706303 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:11:33.706270 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0094c174_8006_40e2_9045_d37ac315323d.slice/crio-d92ac87d35530a0ca3a8687bfa1ab8048ea02741c1b2dabfceb6bcc6060418d3 WatchSource:0}: Error finding container d92ac87d35530a0ca3a8687bfa1ab8048ea02741c1b2dabfceb6bcc6060418d3: Status 404 returned error can't find the container with id d92ac87d35530a0ca3a8687bfa1ab8048ea02741c1b2dabfceb6bcc6060418d3 Jul 09 20:11:33.988696 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:33.988657 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" event={"ID":"0094c174-8006-40e2-9045-d37ac315323d","Type":"ContainerStarted","Data":"d92ac87d35530a0ca3a8687bfa1ab8048ea02741c1b2dabfceb6bcc6060418d3"} Jul 09 20:11:36.000143 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:36.000109 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" event={"ID":"0094c174-8006-40e2-9045-d37ac315323d","Type":"ContainerStarted","Data":"ef852a334e3a201e6524d75e9298edba4349d3c70d63a87bcc8c025f2acc4669"} Jul 09 20:11:36.000758 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:36.000311 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:36.018108 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:36.018052 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" podStartSLOduration=1.602617266 podStartE2EDuration="3.018033537s" totalImagesPullingTime="1.415416271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:11:36.016630813 +0000 UTC m=+516.473768115" watchObservedRunningTime="2026-07-09 20:11:36.018033537 +0000 UTC m=+516.475170773" Jul 09 20:11:39.023023 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:39.022992 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:39.130820 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:39.130784 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:39.621897 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:39.621835 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:39.814608 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:39.814571 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:39.973894 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:39.973859 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:40.067594 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.067565 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn"] Jul 09 20:11:40.070551 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.070532 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.074095 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.074069 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 20:11:40.074290 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.074178 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wc5fj\"" Jul 09 20:11:40.074483 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.074438 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 20:11:40.074882 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.074861 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 20:11:40.079231 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.079195 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 20:11:40.101753 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.101707 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn"] Jul 09 20:11:40.209526 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.209489 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07c530b7-da69-4a16-a647-abddfa331470-manifests\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.209526 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.209527 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hsjj\" (UniqueName: \"kubernetes.io/projected/07c530b7-da69-4a16-a647-abddfa331470-kube-api-access-2hsjj\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.209745 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.209594 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07c530b7-da69-4a16-a647-abddfa331470-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.209745 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.209663 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c530b7-da69-4a16-a647-abddfa331470-tmp\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.209745 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.209680 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07c530b7-da69-4a16-a647-abddfa331470-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.297787 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.297686 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:40.310887 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.310845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07c530b7-da69-4a16-a647-abddfa331470-manifests\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.310887 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.310887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hsjj\" (UniqueName: \"kubernetes.io/projected/07c530b7-da69-4a16-a647-abddfa331470-kube-api-access-2hsjj\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.311156 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.310919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07c530b7-da69-4a16-a647-abddfa331470-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.311156 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.310957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c530b7-da69-4a16-a647-abddfa331470-tmp\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.311156 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.310974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07c530b7-da69-4a16-a647-abddfa331470-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.311353 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.311330 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07c530b7-da69-4a16-a647-abddfa331470-manifests\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.313573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.313541 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c530b7-da69-4a16-a647-abddfa331470-tmp\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.313750 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.313732 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07c530b7-da69-4a16-a647-abddfa331470-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.314150 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.314131 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07c530b7-da69-4a16-a647-abddfa331470-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.321635 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.321600 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hsjj\" (UniqueName: \"kubernetes.io/projected/07c530b7-da69-4a16-a647-abddfa331470-kube-api-access-2hsjj\") pod \"opendatahub-operator-controller-manager-64f986597c-pltdn\" (UID: \"07c530b7-da69-4a16-a647-abddfa331470\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.381714 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.381669 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:40.398830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.398798 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:40.473140 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.473005 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:40.532302 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.532274 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn"] Jul 09 20:11:40.535239 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:11:40.535211 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c530b7_da69_4a16_a647_abddfa331470.slice/crio-18ec961cef91e639580fd779584390d8629794a9c95124b3b81caaf15db192af WatchSource:0}: Error finding container 18ec961cef91e639580fd779584390d8629794a9c95124b3b81caaf15db192af: Status 404 returned error can't find the container with id 18ec961cef91e639580fd779584390d8629794a9c95124b3b81caaf15db192af Jul 09 20:11:40.543533 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.543510 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:40.643306 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.643270 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:40.749911 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:40.749874 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:41.028159 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:41.028064 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" event={"ID":"07c530b7-da69-4a16-a647-abddfa331470","Type":"ContainerStarted","Data":"18ec961cef91e639580fd779584390d8629794a9c95124b3b81caaf15db192af"} Jul 09 20:11:44.045763 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:44.045727 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" event={"ID":"07c530b7-da69-4a16-a647-abddfa331470","Type":"ContainerStarted","Data":"a9785437c6b2988622b497e09d381f2509ed65dea046bd5890d8f6b11ae6781a"} Jul 09 20:11:45.052870 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:45.052826 2583 generic.go:356] "Generic (PLEG): container finished" podID="07c530b7-da69-4a16-a647-abddfa331470" containerID="a9785437c6b2988622b497e09d381f2509ed65dea046bd5890d8f6b11ae6781a" exitCode=0 Jul 09 20:11:45.053369 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:45.052918 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" event={"ID":"07c530b7-da69-4a16-a647-abddfa331470","Type":"ContainerDied","Data":"a9785437c6b2988622b497e09d381f2509ed65dea046bd5890d8f6b11ae6781a"} Jul 09 20:11:46.060046 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:46.060006 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" event={"ID":"07c530b7-da69-4a16-a647-abddfa331470","Type":"ContainerStarted","Data":"d62ab870dc52ac3d39d3bf29bf8fc832354c5bcf722ee1198b9f1ef1277eebbb"} Jul 09 20:11:46.060475 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:46.060120 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:46.089718 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:46.089665 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" podStartSLOduration=1.791288883 podStartE2EDuration="6.089646028s" totalImagesPullingTime="3.284736466s" totalInitContainerRuntime="1.013620679s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:11:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:11:46.087914628 +0000 UTC m=+526.545051867" watchObservedRunningTime="2026-07-09 20:11:46.089646028 +0000 UTC m=+526.546783267" Jul 09 20:11:47.006778 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:47.006752 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-k9wlj" Jul 09 20:11:57.068476 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:57.068384 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-pltdn" Jul 09 20:11:58.634917 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:58.634874 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:58.724229 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:58.724198 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:58.976772 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:58.976687 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:59.144355 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:59.144316 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:59.322122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:59.322028 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:59.425089 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:59.425058 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:59.531012 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:59.530983 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:59.604143 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:59.604060 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:59.680701 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:59.680656 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:11:59.781069 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:11:59.781040 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:00.457610 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.457578 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:00.490815 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.490777 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tvdb5"] Jul 09 20:12:00.500209 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.500176 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:00.502865 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.502843 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-242k8\"" Jul 09 20:12:00.503100 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.503084 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 20:12:00.514155 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.514116 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tvdb5"] Jul 09 20:12:00.550981 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.550953 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:00.588104 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.588063 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47292a09-f0e5-47d0-9029-37f247a3558c-tls-certs\") pod \"model-serving-api-54d89bd5fc-tvdb5\" (UID: \"47292a09-f0e5-47d0-9029-37f247a3558c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:00.588274 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.588134 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmjwb\" (UniqueName: \"kubernetes.io/projected/47292a09-f0e5-47d0-9029-37f247a3558c-kube-api-access-bmjwb\") pod \"model-serving-api-54d89bd5fc-tvdb5\" (UID: \"47292a09-f0e5-47d0-9029-37f247a3558c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:00.689605 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.689564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47292a09-f0e5-47d0-9029-37f247a3558c-tls-certs\") pod \"model-serving-api-54d89bd5fc-tvdb5\" (UID: \"47292a09-f0e5-47d0-9029-37f247a3558c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:00.690008 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.689642 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmjwb\" (UniqueName: \"kubernetes.io/projected/47292a09-f0e5-47d0-9029-37f247a3558c-kube-api-access-bmjwb\") pod \"model-serving-api-54d89bd5fc-tvdb5\" (UID: \"47292a09-f0e5-47d0-9029-37f247a3558c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:00.690008 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:12:00.689689 2583 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 20:12:00.690008 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:12:00.689775 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47292a09-f0e5-47d0-9029-37f247a3558c-tls-certs podName:47292a09-f0e5-47d0-9029-37f247a3558c nodeName:}" failed. No retries permitted until 2026-07-09 20:12:01.189753949 +0000 UTC m=+541.646891167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/47292a09-f0e5-47d0-9029-37f247a3558c-tls-certs") pod "model-serving-api-54d89bd5fc-tvdb5" (UID: "47292a09-f0e5-47d0-9029-37f247a3558c") : secret "model-serving-api-tls" not found Jul 09 20:12:00.699156 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.699124 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmjwb\" (UniqueName: \"kubernetes.io/projected/47292a09-f0e5-47d0-9029-37f247a3558c-kube-api-access-bmjwb\") pod \"model-serving-api-54d89bd5fc-tvdb5\" (UID: \"47292a09-f0e5-47d0-9029-37f247a3558c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:00.880327 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:00.880235 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:01.194184 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:01.194146 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47292a09-f0e5-47d0-9029-37f247a3558c-tls-certs\") pod \"model-serving-api-54d89bd5fc-tvdb5\" (UID: \"47292a09-f0e5-47d0-9029-37f247a3558c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:01.196854 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:01.196829 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47292a09-f0e5-47d0-9029-37f247a3558c-tls-certs\") pod \"model-serving-api-54d89bd5fc-tvdb5\" (UID: \"47292a09-f0e5-47d0-9029-37f247a3558c\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:01.410323 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:01.410285 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:01.434161 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:01.434131 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:01.556250 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:01.556217 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tvdb5"] Jul 09 20:12:01.558943 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:12:01.558917 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47292a09_f0e5_47d0_9029_37f247a3558c.slice/crio-10a6eed89281fcb50cb077c7394a37a0cecaf2d313f09aa6cb9c6168230b8873 WatchSource:0}: Error finding container 10a6eed89281fcb50cb077c7394a37a0cecaf2d313f09aa6cb9c6168230b8873: Status 404 returned error can't find the container with id 10a6eed89281fcb50cb077c7394a37a0cecaf2d313f09aa6cb9c6168230b8873 Jul 09 20:12:02.137333 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:02.137300 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" event={"ID":"47292a09-f0e5-47d0-9029-37f247a3558c","Type":"ContainerStarted","Data":"10a6eed89281fcb50cb077c7394a37a0cecaf2d313f09aa6cb9c6168230b8873"} Jul 09 20:12:04.148890 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:04.148856 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" event={"ID":"47292a09-f0e5-47d0-9029-37f247a3558c","Type":"ContainerStarted","Data":"a33be2fc3c280017c4c90d9686aff96b1893c3a5e744c9ec40eac54f188294e2"} Jul 09 20:12:04.149296 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:04.148985 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:04.167695 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:04.167628 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" podStartSLOduration=1.864383001 podStartE2EDuration="4.167612006s" totalImagesPullingTime="2.303229005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:12:04.16619033 +0000 UTC m=+544.623327584" watchObservedRunningTime="2026-07-09 20:12:04.167612006 +0000 UTC m=+544.624749247" Jul 09 20:12:05.776612 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:05.776574 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:05.875985 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:05.875951 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:06.437171 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.437141 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp"] Jul 09 20:12:06.444066 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.444046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.447105 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.447080 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 20:12:06.447365 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.447350 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 20:12:06.447365 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.447356 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 20:12:06.447531 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.447392 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9q7vr\"" Jul 09 20:12:06.452432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.452321 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp"] Jul 09 20:12:06.461247 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.461214 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:06.543770 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.543736 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.543770 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.543777 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.544035 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.543802 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25062173-0c5c-42df-8707-d4ca3585f117-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.544035 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.543833 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25062173-0c5c-42df-8707-d4ca3585f117-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.544035 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.543940 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.544035 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.543970 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsp8k\" (UniqueName: \"kubernetes.io/projected/25062173-0c5c-42df-8707-d4ca3585f117-kube-api-access-wsp8k\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.544035 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.544030 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.544319 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.544108 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.544319 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.544147 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25062173-0c5c-42df-8707-d4ca3585f117-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.602366 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.602322 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:06.645183 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645140 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645183 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25062173-0c5c-42df-8707-d4ca3585f117-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645211 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25062173-0c5c-42df-8707-d4ca3585f117-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645246 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsp8k\" (UniqueName: \"kubernetes.io/projected/25062173-0c5c-42df-8707-d4ca3585f117-kube-api-access-wsp8k\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645290 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645319 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645352 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25062173-0c5c-42df-8707-d4ca3585f117-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645784 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645784 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645662 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645784 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645730 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.645942 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645856 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.646004 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.645941 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.646090 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.646066 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25062173-0c5c-42df-8707-d4ca3585f117-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.648297 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.648274 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25062173-0c5c-42df-8707-d4ca3585f117-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.648437 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.648421 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25062173-0c5c-42df-8707-d4ca3585f117-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.654737 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.654712 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25062173-0c5c-42df-8707-d4ca3585f117-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.654849 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.654739 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsp8k\" (UniqueName: \"kubernetes.io/projected/25062173-0c5c-42df-8707-d4ca3585f117-kube-api-access-wsp8k\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ghhjp\" (UID: \"25062173-0c5c-42df-8707-d4ca3585f117\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.703875 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.703773 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:06.756663 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.756623 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:06.914287 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:06.914262 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp"] Jul 09 20:12:06.915643 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:12:06.915614 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25062173_0c5c_42df_8707_d4ca3585f117.slice/crio-175d9f1ec27182efe2c74b0f03402690cc3ca810f3170555fa4e18d2f090eb34 WatchSource:0}: Error finding container 175d9f1ec27182efe2c74b0f03402690cc3ca810f3170555fa4e18d2f090eb34: Status 404 returned error can't find the container with id 175d9f1ec27182efe2c74b0f03402690cc3ca810f3170555fa4e18d2f090eb34 Jul 09 20:12:07.165285 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:07.165251 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" event={"ID":"25062173-0c5c-42df-8707-d4ca3585f117","Type":"ContainerStarted","Data":"175d9f1ec27182efe2c74b0f03402690cc3ca810f3170555fa4e18d2f090eb34"} Jul 09 20:12:09.431758 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.431669 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:09.464519 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.464491 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j6rln"] Jul 09 20:12:09.472649 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.472622 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:09.476467 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.476029 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 20:12:09.476467 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.476271 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hqqjn\"" Jul 09 20:12:09.479511 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.479486 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6"] Jul 09 20:12:09.484724 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.484674 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j6rln"] Jul 09 20:12:09.484843 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.484766 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:09.488231 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.488210 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-drt5t\"" Jul 09 20:12:09.490776 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.490751 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 20:12:09.496483 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.496128 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6"] Jul 09 20:12:09.521216 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.521181 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:09.573077 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.573032 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e72e577e-30dd-4ab5-8b02-e926b8480107-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fcx6\" (UID: \"e72e577e-30dd-4ab5-8b02-e926b8480107\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:09.573265 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.573086 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh2lm\" (UniqueName: \"kubernetes.io/projected/e72e577e-30dd-4ab5-8b02-e926b8480107-kube-api-access-xh2lm\") pod \"llmisvc-controller-manager-777c6bd7d5-9fcx6\" (UID: \"e72e577e-30dd-4ab5-8b02-e926b8480107\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:09.573265 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.573218 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-cert\") pod \"kserve-controller-manager-d6f4b65b8-j6rln\" (UID: \"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:09.573265 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.573255 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmf9b\" (UniqueName: \"kubernetes.io/projected/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-kube-api-access-hmf9b\") pod \"kserve-controller-manager-d6f4b65b8-j6rln\" (UID: \"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:09.577892 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.577816 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:09.674560 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.674532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-cert\") pod \"kserve-controller-manager-d6f4b65b8-j6rln\" (UID: \"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:09.674740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.674570 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf9b\" (UniqueName: \"kubernetes.io/projected/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-kube-api-access-hmf9b\") pod \"kserve-controller-manager-d6f4b65b8-j6rln\" (UID: \"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:09.674740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.674595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e72e577e-30dd-4ab5-8b02-e926b8480107-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fcx6\" (UID: \"e72e577e-30dd-4ab5-8b02-e926b8480107\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:09.674740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.674636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh2lm\" (UniqueName: \"kubernetes.io/projected/e72e577e-30dd-4ab5-8b02-e926b8480107-kube-api-access-xh2lm\") pod \"llmisvc-controller-manager-777c6bd7d5-9fcx6\" (UID: \"e72e577e-30dd-4ab5-8b02-e926b8480107\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:09.674740 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:12:09.674694 2583 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 20:12:09.674957 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:12:09.674766 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-cert podName:927f17b9-7b00-4ce9-b6eb-e06a9dc086d8 nodeName:}" failed. No retries permitted until 2026-07-09 20:12:10.174745679 +0000 UTC m=+550.631882900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-cert") pod "kserve-controller-manager-d6f4b65b8-j6rln" (UID: "927f17b9-7b00-4ce9-b6eb-e06a9dc086d8") : secret "kserve-webhook-server-cert" not found Jul 09 20:12:09.677178 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.677155 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e72e577e-30dd-4ab5-8b02-e926b8480107-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fcx6\" (UID: \"e72e577e-30dd-4ab5-8b02-e926b8480107\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:09.696190 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.696121 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmf9b\" (UniqueName: \"kubernetes.io/projected/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-kube-api-access-hmf9b\") pod \"kserve-controller-manager-d6f4b65b8-j6rln\" (UID: \"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:09.699905 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.699875 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh2lm\" (UniqueName: \"kubernetes.io/projected/e72e577e-30dd-4ab5-8b02-e926b8480107-kube-api-access-xh2lm\") pod \"llmisvc-controller-manager-777c6bd7d5-9fcx6\" (UID: \"e72e577e-30dd-4ab5-8b02-e926b8480107\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:09.738397 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.738362 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 20:12:09.738544 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.738436 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 20:12:09.738544 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.738482 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 20:12:09.805184 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.805124 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:09.969462 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.969420 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6"] Jul 09 20:12:09.972815 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:12:09.972780 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode72e577e_30dd_4ab5_8b02_e926b8480107.slice/crio-6c5e3ff5ab6b68a754d1a21f3d086f28170827ccad99cac232738f052e393702 WatchSource:0}: Error finding container 6c5e3ff5ab6b68a754d1a21f3d086f28170827ccad99cac232738f052e393702: Status 404 returned error can't find the container with id 6c5e3ff5ab6b68a754d1a21f3d086f28170827ccad99cac232738f052e393702 Jul 09 20:12:09.986411 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:09.986365 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:10.180807 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.180773 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-cert\") pod \"kserve-controller-manager-d6f4b65b8-j6rln\" (UID: \"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:10.182349 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.182320 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" event={"ID":"25062173-0c5c-42df-8707-d4ca3585f117","Type":"ContainerStarted","Data":"f494b3c5eb86fcb7faffb4053d39ac4d83c961333befac3111b6cb67c04b2050"} Jul 09 20:12:10.183726 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.183694 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" event={"ID":"e72e577e-30dd-4ab5-8b02-e926b8480107","Type":"ContainerStarted","Data":"6c5e3ff5ab6b68a754d1a21f3d086f28170827ccad99cac232738f052e393702"} Jul 09 20:12:10.183839 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.183829 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/927f17b9-7b00-4ce9-b6eb-e06a9dc086d8-cert\") pod \"kserve-controller-manager-d6f4b65b8-j6rln\" (UID: \"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:10.203643 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.203595 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" podStartSLOduration=1.383212081 podStartE2EDuration="4.203578212s" totalImagesPullingTime="2.820366131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:12:10.201818877 +0000 UTC m=+550.658956141" watchObservedRunningTime="2026-07-09 20:12:10.203578212 +0000 UTC m=+550.660715452" Jul 09 20:12:10.394832 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.394791 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:10.560854 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.560824 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j6rln"] Jul 09 20:12:10.562394 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:12:10.562367 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927f17b9_7b00_4ce9_b6eb_e06a9dc086d8.slice/crio-b049acc133e6d30191508c1682f7e930ea45128b80605c0392598caf6a0dfb00 WatchSource:0}: Error finding container b049acc133e6d30191508c1682f7e930ea45128b80605c0392598caf6a0dfb00: Status 404 returned error can't find the container with id b049acc133e6d30191508c1682f7e930ea45128b80605c0392598caf6a0dfb00 Jul 09 20:12:10.714571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.714483 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:10.757543 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.757505 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:10.762624 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.762599 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:10.844974 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.844943 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:10.953236 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:10.953207 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:11.191767 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:11.191692 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" event={"ID":"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8","Type":"ContainerStarted","Data":"b049acc133e6d30191508c1682f7e930ea45128b80605c0392598caf6a0dfb00"} Jul 09 20:12:11.192101 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:11.192078 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:11.193579 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:11.193555 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ghhjp" Jul 09 20:12:14.210501 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:14.210469 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" event={"ID":"927f17b9-7b00-4ce9-b6eb-e06a9dc086d8","Type":"ContainerStarted","Data":"59832e88bea429847d07b9fbe8f90b8cb8fc25f3f7f9cb850a448dad0e03f8d0"} Jul 09 20:12:14.210967 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:14.210572 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:12:14.212043 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:14.212020 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" event={"ID":"e72e577e-30dd-4ab5-8b02-e926b8480107","Type":"ContainerStarted","Data":"2021906ddc35ae7846c8112bb55c8ad6defd74a0783900c9c4bf5763fb2d4e4a"} Jul 09 20:12:14.212180 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:14.212095 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:14.228089 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:14.228042 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" podStartSLOduration=2.210337594 podStartE2EDuration="5.228028448s" totalImagesPullingTime="3.017690854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:12:14.226752932 +0000 UTC m=+554.683890173" watchObservedRunningTime="2026-07-09 20:12:14.228028448 +0000 UTC m=+554.685165719" Jul 09 20:12:14.244302 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:14.244250 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" podStartSLOduration=1.6397256059999998 podStartE2EDuration="5.244234485s" totalImagesPullingTime="3.604508879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:12:14.242070714 +0000 UTC m=+554.699207955" watchObservedRunningTime="2026-07-09 20:12:14.244234485 +0000 UTC m=+554.701371724" Jul 09 20:12:15.158618 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:15.158583 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tvdb5" Jul 09 20:12:37.646268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:37.646225 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:12:45.220567 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:45.220527 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fcx6" Jul 09 20:12:45.223693 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:12:45.223665 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rln" Jul 09 20:13:00.147805 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:00.147772 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:00.250266 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:00.250106 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:00.333422 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:00.333392 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:01.090197 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:01.090162 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:01.290705 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:01.290664 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:04.809328 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:04.809304 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:13:04.809771 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:04.809517 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:13:15.709473 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.706998 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv"] Jul 09 20:13:15.713701 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.713661 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.716815 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.716777 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 20:13:15.718068 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.718038 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vqwng\"" Jul 09 20:13:15.718303 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.718283 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 20:13:15.720625 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.720597 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv"] Jul 09 20:13:15.798478 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.798409 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.798665 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.798582 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7tn9\" (UniqueName: \"kubernetes.io/projected/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-kube-api-access-s7tn9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.798665 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.798616 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.899665 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.899616 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.899939 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.899736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7tn9\" (UniqueName: \"kubernetes.io/projected/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-kube-api-access-s7tn9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.899939 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.899768 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.900084 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.899995 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.900139 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.900086 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:15.911222 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:15.911184 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7tn9\" (UniqueName: \"kubernetes.io/projected/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-kube-api-access-s7tn9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:16.026034 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.025933 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:16.193031 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.193005 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv"] Jul 09 20:13:16.195718 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:13:16.195688 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4eb2f3e_bc5f_4b2c_b024_38296aeece4c.slice/crio-c3a57128a0f196403f33142c552d9a6f54878bc7473dbc24a53e8bf5f634bf81 WatchSource:0}: Error finding container c3a57128a0f196403f33142c552d9a6f54878bc7473dbc24a53e8bf5f634bf81: Status 404 returned error can't find the container with id c3a57128a0f196403f33142c552d9a6f54878bc7473dbc24a53e8bf5f634bf81 Jul 09 20:13:16.351286 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.351247 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5"] Jul 09 20:13:16.354846 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.354829 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.363914 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.363886 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5"] Jul 09 20:13:16.505074 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.505035 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbtj\" (UniqueName: \"kubernetes.io/projected/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-kube-api-access-9cbtj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.505260 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.505087 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.505260 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.505165 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.536997 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.536957 2583 generic.go:356] "Generic (PLEG): container finished" podID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerID="85ab83f8eca8358fd87f47a2d8a8d1f58d9df82a90130a2019c71e1efa146935" exitCode=0 Jul 09 20:13:16.537168 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.537053 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" event={"ID":"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c","Type":"ContainerDied","Data":"85ab83f8eca8358fd87f47a2d8a8d1f58d9df82a90130a2019c71e1efa146935"} Jul 09 20:13:16.537168 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.537105 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" event={"ID":"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c","Type":"ContainerStarted","Data":"c3a57128a0f196403f33142c552d9a6f54878bc7473dbc24a53e8bf5f634bf81"} Jul 09 20:13:16.537577 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.537561 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 20:13:16.606468 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.606350 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbtj\" (UniqueName: \"kubernetes.io/projected/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-kube-api-access-9cbtj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.606468 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.606402 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.606716 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.606601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.606838 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.606814 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.606903 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.606889 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.616556 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.616529 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbtj\" (UniqueName: \"kubernetes.io/projected/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-kube-api-access-9cbtj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.676174 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.676136 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:16.815715 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.815682 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9"] Jul 09 20:13:16.820551 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.820521 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:16.833520 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.833490 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9"] Jul 09 20:13:16.839129 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.839104 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5"] Jul 09 20:13:16.841970 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:13:16.841941 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fea8ea_d85d_4ffd_a0ca_a6ab411eb625.slice/crio-acea4a3a8a397fdc095070f9b07b56374f4aef06497a2a5fd07606e71eb88e4d WatchSource:0}: Error finding container acea4a3a8a397fdc095070f9b07b56374f4aef06497a2a5fd07606e71eb88e4d: Status 404 returned error can't find the container with id acea4a3a8a397fdc095070f9b07b56374f4aef06497a2a5fd07606e71eb88e4d Jul 09 20:13:16.908885 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.908855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2kmz\" (UniqueName: \"kubernetes.io/projected/44cb1a0d-bb20-4d08-aca7-97de893cd174-kube-api-access-f2kmz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:16.909029 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.908915 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:16.909029 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:16.909001 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:17.009808 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.009775 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:17.010001 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.009877 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:17.010001 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.009933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2kmz\" (UniqueName: \"kubernetes.io/projected/44cb1a0d-bb20-4d08-aca7-97de893cd174-kube-api-access-f2kmz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:17.010212 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.010189 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:17.010271 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.010197 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:17.022876 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.022842 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2kmz\" (UniqueName: \"kubernetes.io/projected/44cb1a0d-bb20-4d08-aca7-97de893cd174-kube-api-access-f2kmz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:17.133388 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.133269 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:17.135676 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.135636 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql"] Jul 09 20:13:17.139331 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.139308 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.147732 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.147703 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql"] Jul 09 20:13:17.313613 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.313570 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.313810 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.313661 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndnt7\" (UniqueName: \"kubernetes.io/projected/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-kube-api-access-ndnt7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.313810 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.313687 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.329130 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.329104 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9"] Jul 09 20:13:17.331432 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:13:17.331403 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cb1a0d_bb20_4d08_aca7_97de893cd174.slice/crio-84bde9c5055c28611c921aa7fe8a95107ea623eddfd833cc196979ace83c10e2 WatchSource:0}: Error finding container 84bde9c5055c28611c921aa7fe8a95107ea623eddfd833cc196979ace83c10e2: Status 404 returned error can't find the container with id 84bde9c5055c28611c921aa7fe8a95107ea623eddfd833cc196979ace83c10e2 Jul 09 20:13:17.414162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.414126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.414270 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.414219 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.414315 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.414274 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndnt7\" (UniqueName: \"kubernetes.io/projected/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-kube-api-access-ndnt7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.414617 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.414576 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.414735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.414638 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.424933 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.424898 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndnt7\" (UniqueName: \"kubernetes.io/projected/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-kube-api-access-ndnt7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.452091 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.452038 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:17.544132 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.544081 2583 generic.go:356] "Generic (PLEG): container finished" podID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerID="75b99f6c4d8b682b6fec060a851a3b0451348135733639d60108a8ef0a32cd2a" exitCode=0 Jul 09 20:13:17.544298 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.544141 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" event={"ID":"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c","Type":"ContainerDied","Data":"75b99f6c4d8b682b6fec060a851a3b0451348135733639d60108a8ef0a32cd2a"} Jul 09 20:13:17.547012 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.546985 2583 generic.go:356] "Generic (PLEG): container finished" podID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerID="b7c7a8c43b95e18b240e253910dd8fb01c06a2454bf9112db3a1698bcea1da4b" exitCode=0 Jul 09 20:13:17.547139 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.547066 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" event={"ID":"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625","Type":"ContainerDied","Data":"b7c7a8c43b95e18b240e253910dd8fb01c06a2454bf9112db3a1698bcea1da4b"} Jul 09 20:13:17.547139 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.547125 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" event={"ID":"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625","Type":"ContainerStarted","Data":"acea4a3a8a397fdc095070f9b07b56374f4aef06497a2a5fd07606e71eb88e4d"} Jul 09 20:13:17.550815 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.550480 2583 generic.go:356] "Generic (PLEG): container finished" podID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerID="3c0d99f650d685b5761ac0a741915901ee4b1228a1a801fafb7104e04763b7b5" exitCode=0 Jul 09 20:13:17.550815 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.550604 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" event={"ID":"44cb1a0d-bb20-4d08-aca7-97de893cd174","Type":"ContainerDied","Data":"3c0d99f650d685b5761ac0a741915901ee4b1228a1a801fafb7104e04763b7b5"} Jul 09 20:13:17.550815 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.550713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" event={"ID":"44cb1a0d-bb20-4d08-aca7-97de893cd174","Type":"ContainerStarted","Data":"84bde9c5055c28611c921aa7fe8a95107ea623eddfd833cc196979ace83c10e2"} Jul 09 20:13:17.621340 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:17.621302 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql"] Jul 09 20:13:17.622566 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:13:17.622533 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ed56b6_0307_4d4a_b5c1_ae26046bc93d.slice/crio-b61c608d10882ea8f895bfe89de3d98721215b1c36217d3a1f612e437b2149c0 WatchSource:0}: Error finding container b61c608d10882ea8f895bfe89de3d98721215b1c36217d3a1f612e437b2149c0: Status 404 returned error can't find the container with id b61c608d10882ea8f895bfe89de3d98721215b1c36217d3a1f612e437b2149c0 Jul 09 20:13:18.558039 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:18.558009 2583 generic.go:356] "Generic (PLEG): container finished" podID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerID="646c4cb5287c3b79e71068c2344a57f4e9aca8de1fa96a5eaa94972622649d87" exitCode=0 Jul 09 20:13:18.558509 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:18.558096 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" event={"ID":"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c","Type":"ContainerDied","Data":"646c4cb5287c3b79e71068c2344a57f4e9aca8de1fa96a5eaa94972622649d87"} Jul 09 20:13:18.559622 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:18.559599 2583 generic.go:356] "Generic (PLEG): container finished" podID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerID="e8d097364bb5020d2c5f4295a87481e992698b2fb374a586dff219166e26d297" exitCode=0 Jul 09 20:13:18.559714 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:18.559648 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" event={"ID":"89ed56b6-0307-4d4a-b5c1-ae26046bc93d","Type":"ContainerDied","Data":"e8d097364bb5020d2c5f4295a87481e992698b2fb374a586dff219166e26d297"} Jul 09 20:13:18.559714 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:18.559685 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" event={"ID":"89ed56b6-0307-4d4a-b5c1-ae26046bc93d","Type":"ContainerStarted","Data":"b61c608d10882ea8f895bfe89de3d98721215b1c36217d3a1f612e437b2149c0"} Jul 09 20:13:19.567137 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.567103 2583 generic.go:356] "Generic (PLEG): container finished" podID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerID="04ee91f8aa75cb4e7cca8deb800569515420f5ae296997a67a39c2f69eb272b2" exitCode=0 Jul 09 20:13:19.567566 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.567176 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" event={"ID":"44cb1a0d-bb20-4d08-aca7-97de893cd174","Type":"ContainerDied","Data":"04ee91f8aa75cb4e7cca8deb800569515420f5ae296997a67a39c2f69eb272b2"} Jul 09 20:13:19.569296 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.569275 2583 generic.go:356] "Generic (PLEG): container finished" podID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerID="1b204078b34ee1b3ca96761a641d8d8bf36d4574582cdb09a821e447f8721e41" exitCode=0 Jul 09 20:13:19.569381 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.569352 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" event={"ID":"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625","Type":"ContainerDied","Data":"1b204078b34ee1b3ca96761a641d8d8bf36d4574582cdb09a821e447f8721e41"} Jul 09 20:13:19.571279 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.571258 2583 generic.go:356] "Generic (PLEG): container finished" podID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerID="60ef1cb09f043e5a5c0f2eff06e11e9fd6b69c9b6b8a2ec79c186caed87a7749" exitCode=0 Jul 09 20:13:19.571353 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.571335 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" event={"ID":"89ed56b6-0307-4d4a-b5c1-ae26046bc93d","Type":"ContainerDied","Data":"60ef1cb09f043e5a5c0f2eff06e11e9fd6b69c9b6b8a2ec79c186caed87a7749"} Jul 09 20:13:19.734180 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.734098 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:19.836278 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.836212 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-util\") pod \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " Jul 09 20:13:19.836278 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.836254 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-bundle\") pod \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " Jul 09 20:13:19.836479 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.836345 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7tn9\" (UniqueName: \"kubernetes.io/projected/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-kube-api-access-s7tn9\") pod \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\" (UID: \"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c\") " Jul 09 20:13:19.836765 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.836741 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-bundle" (OuterVolumeSpecName: "bundle") pod "e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" (UID: "e4eb2f3e-bc5f-4b2c-b024-38296aeece4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:13:19.838590 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.838568 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-kube-api-access-s7tn9" (OuterVolumeSpecName: "kube-api-access-s7tn9") pod "e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" (UID: "e4eb2f3e-bc5f-4b2c-b024-38296aeece4c"). InnerVolumeSpecName "kube-api-access-s7tn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:13:19.841743 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.841709 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-util" (OuterVolumeSpecName: "util") pod "e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" (UID: "e4eb2f3e-bc5f-4b2c-b024-38296aeece4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:13:19.937425 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.937388 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-util\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:19.937425 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.937416 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:19.937425 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:19.937426 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7tn9\" (UniqueName: \"kubernetes.io/projected/e4eb2f3e-bc5f-4b2c-b024-38296aeece4c-kube-api-access-s7tn9\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:20.579525 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.579145 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" event={"ID":"e4eb2f3e-bc5f-4b2c-b024-38296aeece4c","Type":"ContainerDied","Data":"c3a57128a0f196403f33142c552d9a6f54878bc7473dbc24a53e8bf5f634bf81"} Jul 09 20:13:20.579525 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.579216 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3a57128a0f196403f33142c552d9a6f54878bc7473dbc24a53e8bf5f634bf81" Jul 09 20:13:20.579525 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.579156 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv" Jul 09 20:13:20.582652 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.582276 2583 generic.go:356] "Generic (PLEG): container finished" podID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerID="23a7a033bb21138c0426ac431d47bcaefbf43357759eca7859da47d4cefd7a71" exitCode=0 Jul 09 20:13:20.582652 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.582364 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" event={"ID":"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625","Type":"ContainerDied","Data":"23a7a033bb21138c0426ac431d47bcaefbf43357759eca7859da47d4cefd7a71"} Jul 09 20:13:20.585208 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.585182 2583 generic.go:356] "Generic (PLEG): container finished" podID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerID="396d11ae87cdc636647938a7904c77fa95f078baa598b7c93a303cf6076f660c" exitCode=0 Jul 09 20:13:20.585343 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.585269 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" event={"ID":"89ed56b6-0307-4d4a-b5c1-ae26046bc93d","Type":"ContainerDied","Data":"396d11ae87cdc636647938a7904c77fa95f078baa598b7c93a303cf6076f660c"} Jul 09 20:13:20.587793 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.587769 2583 generic.go:356] "Generic (PLEG): container finished" podID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerID="e8b4b00113371e588bdd2d258dc6c33dd8dba423192c5dd9323fe67634ce2b42" exitCode=0 Jul 09 20:13:20.587930 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:20.587824 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" event={"ID":"44cb1a0d-bb20-4d08-aca7-97de893cd174","Type":"ContainerDied","Data":"e8b4b00113371e588bdd2d258dc6c33dd8dba423192c5dd9323fe67634ce2b42"} Jul 09 20:13:21.759584 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.759558 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:21.786133 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.786103 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:21.790904 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.790876 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:21.856944 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.856866 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndnt7\" (UniqueName: \"kubernetes.io/projected/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-kube-api-access-ndnt7\") pod \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " Jul 09 20:13:21.857075 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.856967 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-util\") pod \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " Jul 09 20:13:21.857075 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.856991 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-bundle\") pod \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\" (UID: \"89ed56b6-0307-4d4a-b5c1-ae26046bc93d\") " Jul 09 20:13:21.857596 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.857551 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-bundle" (OuterVolumeSpecName: "bundle") pod "89ed56b6-0307-4d4a-b5c1-ae26046bc93d" (UID: "89ed56b6-0307-4d4a-b5c1-ae26046bc93d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:13:21.859162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.859132 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-kube-api-access-ndnt7" (OuterVolumeSpecName: "kube-api-access-ndnt7") pod "89ed56b6-0307-4d4a-b5c1-ae26046bc93d" (UID: "89ed56b6-0307-4d4a-b5c1-ae26046bc93d"). InnerVolumeSpecName "kube-api-access-ndnt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:13:21.862337 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.862316 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-util" (OuterVolumeSpecName: "util") pod "89ed56b6-0307-4d4a-b5c1-ae26046bc93d" (UID: "89ed56b6-0307-4d4a-b5c1-ae26046bc93d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:13:21.958068 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958029 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cbtj\" (UniqueName: \"kubernetes.io/projected/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-kube-api-access-9cbtj\") pod \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " Jul 09 20:13:21.958068 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958066 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2kmz\" (UniqueName: \"kubernetes.io/projected/44cb1a0d-bb20-4d08-aca7-97de893cd174-kube-api-access-f2kmz\") pod \"44cb1a0d-bb20-4d08-aca7-97de893cd174\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " Jul 09 20:13:21.958305 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958100 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-util\") pod \"44cb1a0d-bb20-4d08-aca7-97de893cd174\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " Jul 09 20:13:21.958305 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958135 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-bundle\") pod \"44cb1a0d-bb20-4d08-aca7-97de893cd174\" (UID: \"44cb1a0d-bb20-4d08-aca7-97de893cd174\") " Jul 09 20:13:21.958305 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958174 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-bundle\") pod \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " Jul 09 20:13:21.958305 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958249 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-util\") pod \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\" (UID: \"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625\") " Jul 09 20:13:21.958645 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958628 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndnt7\" (UniqueName: \"kubernetes.io/projected/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-kube-api-access-ndnt7\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:21.958700 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958649 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-util\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:21.958700 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958662 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89ed56b6-0307-4d4a-b5c1-ae26046bc93d-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:21.958840 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958810 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-bundle" (OuterVolumeSpecName: "bundle") pod "33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" (UID: "33fea8ea-d85d-4ffd-a0ca-a6ab411eb625"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:13:21.958916 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.958906 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-bundle" (OuterVolumeSpecName: "bundle") pod "44cb1a0d-bb20-4d08-aca7-97de893cd174" (UID: "44cb1a0d-bb20-4d08-aca7-97de893cd174"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:13:21.960376 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.960346 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-kube-api-access-9cbtj" (OuterVolumeSpecName: "kube-api-access-9cbtj") pod "33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" (UID: "33fea8ea-d85d-4ffd-a0ca-a6ab411eb625"). InnerVolumeSpecName "kube-api-access-9cbtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:13:21.960772 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.960751 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44cb1a0d-bb20-4d08-aca7-97de893cd174-kube-api-access-f2kmz" (OuterVolumeSpecName: "kube-api-access-f2kmz") pod "44cb1a0d-bb20-4d08-aca7-97de893cd174" (UID: "44cb1a0d-bb20-4d08-aca7-97de893cd174"). InnerVolumeSpecName "kube-api-access-f2kmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:13:21.964380 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.964345 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-util" (OuterVolumeSpecName: "util") pod "44cb1a0d-bb20-4d08-aca7-97de893cd174" (UID: "44cb1a0d-bb20-4d08-aca7-97de893cd174"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:13:21.965582 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:21.965560 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-util" (OuterVolumeSpecName: "util") pod "33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" (UID: "33fea8ea-d85d-4ffd-a0ca-a6ab411eb625"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:13:22.059521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.059484 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-util\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:22.059521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.059519 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cbtj\" (UniqueName: \"kubernetes.io/projected/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-kube-api-access-9cbtj\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:22.059521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.059531 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2kmz\" (UniqueName: \"kubernetes.io/projected/44cb1a0d-bb20-4d08-aca7-97de893cd174-kube-api-access-f2kmz\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:22.059757 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.059541 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-util\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:22.059757 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.059550 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44cb1a0d-bb20-4d08-aca7-97de893cd174-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:22.059757 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.059558 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33fea8ea-d85d-4ffd-a0ca-a6ab411eb625-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:13:22.600244 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.600210 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" event={"ID":"33fea8ea-d85d-4ffd-a0ca-a6ab411eb625","Type":"ContainerDied","Data":"acea4a3a8a397fdc095070f9b07b56374f4aef06497a2a5fd07606e71eb88e4d"} Jul 09 20:13:22.600244 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.600244 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5" Jul 09 20:13:22.600523 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.600268 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acea4a3a8a397fdc095070f9b07b56374f4aef06497a2a5fd07606e71eb88e4d" Jul 09 20:13:22.602659 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.602360 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" Jul 09 20:13:22.602659 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.602362 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql" event={"ID":"89ed56b6-0307-4d4a-b5c1-ae26046bc93d","Type":"ContainerDied","Data":"b61c608d10882ea8f895bfe89de3d98721215b1c36217d3a1f612e437b2149c0"} Jul 09 20:13:22.602659 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.602513 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b61c608d10882ea8f895bfe89de3d98721215b1c36217d3a1f612e437b2149c0" Jul 09 20:13:22.604488 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.604468 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" Jul 09 20:13:22.604488 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.604476 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9" event={"ID":"44cb1a0d-bb20-4d08-aca7-97de893cd174","Type":"ContainerDied","Data":"84bde9c5055c28611c921aa7fe8a95107ea623eddfd833cc196979ace83c10e2"} Jul 09 20:13:22.604617 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:22.604520 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84bde9c5055c28611c921aa7fe8a95107ea623eddfd833cc196979ace83c10e2" Jul 09 20:13:28.939700 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:28.939662 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:32.381549 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:32.381497 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:34.313067 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:34.313031 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:35.908488 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:35.908430 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:36.449820 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:36.449786 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:37.760335 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:37.760300 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.099589 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz"] Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100435 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerName="pull" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100494 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerName="pull" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100516 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerName="util" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100524 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerName="util" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100539 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerName="pull" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100554 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerName="pull" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100571 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100579 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100600 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerName="util" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100608 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerName="util" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100624 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100633 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100644 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100652 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100669 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100676 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100695 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerName="util" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100702 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerName="util" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100718 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerName="pull" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100725 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerName="pull" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100750 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerName="util" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100758 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerName="util" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100772 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerName="pull" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100780 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerName="pull" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100953 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ed56b6-0307-4d4a-b5c1-ae26046bc93d" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100972 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="44cb1a0d-bb20-4d08-aca7-97de893cd174" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100982 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4eb2f3e-bc5f-4b2c-b024-38296aeece4c" containerName="extract" Jul 09 20:13:38.104189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.100992 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="33fea8ea-d85d-4ffd-a0ca-a6ab411eb625" containerName="extract" Jul 09 20:13:38.106508 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.106487 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" Jul 09 20:13:38.110596 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.110571 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 20:13:38.110735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.110575 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cmkkt\"" Jul 09 20:13:38.110735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.110606 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 20:13:38.114363 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.114295 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz"] Jul 09 20:13:38.197338 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.197297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w7mw\" (UniqueName: \"kubernetes.io/projected/acad012b-39b5-4356-8d64-f3ac7e25a4db-kube-api-access-8w7mw\") pod \"authorino-operator-75cc8d5cb7-rf4cz\" (UID: \"acad012b-39b5-4356-8d64-f3ac7e25a4db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" Jul 09 20:13:38.298490 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.298428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w7mw\" (UniqueName: \"kubernetes.io/projected/acad012b-39b5-4356-8d64-f3ac7e25a4db-kube-api-access-8w7mw\") pod \"authorino-operator-75cc8d5cb7-rf4cz\" (UID: \"acad012b-39b5-4356-8d64-f3ac7e25a4db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" Jul 09 20:13:38.314081 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.314054 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w7mw\" (UniqueName: \"kubernetes.io/projected/acad012b-39b5-4356-8d64-f3ac7e25a4db-kube-api-access-8w7mw\") pod \"authorino-operator-75cc8d5cb7-rf4cz\" (UID: \"acad012b-39b5-4356-8d64-f3ac7e25a4db\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" Jul 09 20:13:38.418360 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.418327 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" Jul 09 20:13:38.567051 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.567021 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz"] Jul 09 20:13:38.569689 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:13:38.569659 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacad012b_39b5_4356_8d64_f3ac7e25a4db.slice/crio-a9a136bb9f2232145f6dec1579337ad2cc2b074f0d3ff64d397d769db642e265 WatchSource:0}: Error finding container a9a136bb9f2232145f6dec1579337ad2cc2b074f0d3ff64d397d769db642e265: Status 404 returned error can't find the container with id a9a136bb9f2232145f6dec1579337ad2cc2b074f0d3ff64d397d769db642e265 Jul 09 20:13:38.691054 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:38.690959 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" event={"ID":"acad012b-39b5-4356-8d64-f3ac7e25a4db","Type":"ContainerStarted","Data":"a9a136bb9f2232145f6dec1579337ad2cc2b074f0d3ff64d397d769db642e265"} Jul 09 20:13:39.318866 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:39.318838 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:40.167786 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:40.167746 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:40.306578 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:40.306544 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:41.711933 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:41.711900 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" event={"ID":"acad012b-39b5-4356-8d64-f3ac7e25a4db","Type":"ContainerStarted","Data":"5e569a669afa2f1f3016223ecde3e9b3f60fc009cc81df1f91a88cc43fa69ead"} Jul 09 20:13:41.712352 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:41.712040 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" Jul 09 20:13:41.739301 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:41.739252 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" podStartSLOduration=1.056466766 podStartE2EDuration="3.739235484s" totalImagesPullingTime="2.682768718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:13:41.738108774 +0000 UTC m=+642.195246015" watchObservedRunningTime="2026-07-09 20:13:41.739235484 +0000 UTC m=+642.196372762" Jul 09 20:13:42.154360 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:42.154324 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:43.793396 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:43.793362 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:43.901696 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:43.901656 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:44.002587 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:44.002552 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:44.301212 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:44.301178 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:51.518541 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:51.518502 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:51.626392 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:51.626361 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:52.719369 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:52.719331 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf4cz" Jul 09 20:13:56.334763 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:56.334723 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:56.436583 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:56.436548 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:58.747279 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:58.747243 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:13:58.809744 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:13:58.809714 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:04.321900 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:04.321870 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:04.382847 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:04.382805 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:06.851762 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:06.851726 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd"] Jul 09 20:14:06.861411 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:06.861378 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:06.864481 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:06.864437 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-btptb\"" Jul 09 20:14:06.868702 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:06.868679 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd"] Jul 09 20:14:06.970350 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:06.970305 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cspn2\" (UniqueName: \"kubernetes.io/projected/64818c3a-376f-4d8d-bcab-e036279fe1f4-kube-api-access-cspn2\") pod \"kuadrant-operator-controller-manager-86878c769f-9c9fd\" (UID: \"64818c3a-376f-4d8d-bcab-e036279fe1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:06.970565 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:06.970412 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64818c3a-376f-4d8d-bcab-e036279fe1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9c9fd\" (UID: \"64818c3a-376f-4d8d-bcab-e036279fe1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:07.071589 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:07.071550 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cspn2\" (UniqueName: \"kubernetes.io/projected/64818c3a-376f-4d8d-bcab-e036279fe1f4-kube-api-access-cspn2\") pod \"kuadrant-operator-controller-manager-86878c769f-9c9fd\" (UID: \"64818c3a-376f-4d8d-bcab-e036279fe1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:07.071767 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:07.071625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64818c3a-376f-4d8d-bcab-e036279fe1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9c9fd\" (UID: \"64818c3a-376f-4d8d-bcab-e036279fe1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:07.071995 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:07.071976 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64818c3a-376f-4d8d-bcab-e036279fe1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9c9fd\" (UID: \"64818c3a-376f-4d8d-bcab-e036279fe1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:07.080294 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:07.080265 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cspn2\" (UniqueName: \"kubernetes.io/projected/64818c3a-376f-4d8d-bcab-e036279fe1f4-kube-api-access-cspn2\") pod \"kuadrant-operator-controller-manager-86878c769f-9c9fd\" (UID: \"64818c3a-376f-4d8d-bcab-e036279fe1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:07.173346 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:07.173308 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:07.326684 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:07.326659 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd"] Jul 09 20:14:07.329298 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:14:07.329267 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64818c3a_376f_4d8d_bcab_e036279fe1f4.slice/crio-8d6e26e5a7418aed4d161db4981145269acbcfe66e543e57189595f664a1ce79 WatchSource:0}: Error finding container 8d6e26e5a7418aed4d161db4981145269acbcfe66e543e57189595f664a1ce79: Status 404 returned error can't find the container with id 8d6e26e5a7418aed4d161db4981145269acbcfe66e543e57189595f664a1ce79 Jul 09 20:14:07.853095 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:07.853057 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" event={"ID":"64818c3a-376f-4d8d-bcab-e036279fe1f4","Type":"ContainerStarted","Data":"8d6e26e5a7418aed4d161db4981145269acbcfe66e543e57189595f664a1ce79"} Jul 09 20:14:11.263221 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:11.263169 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:11.393849 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:11.393815 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:12.886616 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:12.886583 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" event={"ID":"64818c3a-376f-4d8d-bcab-e036279fe1f4","Type":"ContainerStarted","Data":"d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7"} Jul 09 20:14:12.887029 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:12.886722 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:12.907748 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:12.907694 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" podStartSLOduration=1.732792417 podStartE2EDuration="6.907674267s" totalImagesPullingTime="5.17488185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:14:12.905812328 +0000 UTC m=+673.362949600" watchObservedRunningTime="2026-07-09 20:14:12.907674267 +0000 UTC m=+673.364811523" Jul 09 20:14:16.057815 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:16.057771 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:16.156171 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:16.156139 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:18.512678 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:18.512634 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:18.612908 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:18.612862 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:23.040627 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:23.040590 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:23.558763 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:23.558710 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:23.895160 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:23.895126 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:14:24.284568 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:24.284475 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:24.400418 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:24.400389 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:31.670651 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:31.670617 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:31.775435 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:31.775399 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:36.270661 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:36.270629 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:36.369185 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:36.369155 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:38.728282 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:38.728228 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:38.782963 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:38.782935 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:40.152793 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:40.152752 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:40.203250 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:40.203218 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:40.902179 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:40.902145 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:41.002870 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:41.002836 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:41.943248 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:41.943215 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:42.084821 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.084754 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:42.186091 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.186051 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:42.808085 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.808050 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:42.909488 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.909438 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:42.910541 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.910522 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xjxq5"] Jul 09 20:14:42.919706 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.919678 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xjxq5" Jul 09 20:14:42.921255 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.921230 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xjxq5"] Jul 09 20:14:42.922224 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.922203 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z9bp7\"" Jul 09 20:14:42.991697 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:42.991663 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsf9j\" (UniqueName: \"kubernetes.io/projected/7b6b0052-cc7e-43e9-b291-3c980c5496d4-kube-api-access-dsf9j\") pod \"authorino-75d556bd77-xjxq5\" (UID: \"7b6b0052-cc7e-43e9-b291-3c980c5496d4\") " pod="kuadrant-system/authorino-75d556bd77-xjxq5" Jul 09 20:14:43.093107 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:43.093024 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsf9j\" (UniqueName: \"kubernetes.io/projected/7b6b0052-cc7e-43e9-b291-3c980c5496d4-kube-api-access-dsf9j\") pod \"authorino-75d556bd77-xjxq5\" (UID: \"7b6b0052-cc7e-43e9-b291-3c980c5496d4\") " pod="kuadrant-system/authorino-75d556bd77-xjxq5" Jul 09 20:14:43.101512 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:43.101479 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsf9j\" (UniqueName: \"kubernetes.io/projected/7b6b0052-cc7e-43e9-b291-3c980c5496d4-kube-api-access-dsf9j\") pod \"authorino-75d556bd77-xjxq5\" (UID: \"7b6b0052-cc7e-43e9-b291-3c980c5496d4\") " pod="kuadrant-system/authorino-75d556bd77-xjxq5" Jul 09 20:14:43.229375 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:43.229343 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xjxq5" Jul 09 20:14:43.385692 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:14:43.385660 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b6b0052_cc7e_43e9_b291_3c980c5496d4.slice/crio-80fa3192c0fee0a74cd74adb3b1811b2d0f68af7aef968f14d701dfd3b18194c WatchSource:0}: Error finding container 80fa3192c0fee0a74cd74adb3b1811b2d0f68af7aef968f14d701dfd3b18194c: Status 404 returned error can't find the container with id 80fa3192c0fee0a74cd74adb3b1811b2d0f68af7aef968f14d701dfd3b18194c Jul 09 20:14:43.388198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:43.388173 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xjxq5"] Jul 09 20:14:44.065493 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:44.065434 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xjxq5" event={"ID":"7b6b0052-cc7e-43e9-b291-3c980c5496d4","Type":"ContainerStarted","Data":"80fa3192c0fee0a74cd74adb3b1811b2d0f68af7aef968f14d701dfd3b18194c"} Jul 09 20:14:48.096326 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:48.096292 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xjxq5" event={"ID":"7b6b0052-cc7e-43e9-b291-3c980c5496d4","Type":"ContainerStarted","Data":"3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3"} Jul 09 20:14:48.108070 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:48.108016 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xjxq5" podStartSLOduration=2.224683724 podStartE2EDuration="6.107999869s" totalImagesPullingTime="3.883316145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:14:48.106216769 +0000 UTC m=+708.563354011" watchObservedRunningTime="2026-07-09 20:14:48.107999869 +0000 UTC m=+708.565137109" Jul 09 20:14:59.426403 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:59.426269 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:59.491823 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:59.491792 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:14:59.913072 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:14:59.912743 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:04.345669 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:04.345635 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:12.251891 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:12.251853 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:12.813939 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:12.813908 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:16.977707 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:16.977667 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xjxq5"] Jul 09 20:15:16.978128 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:16.977845 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xjxq5" podUID="7b6b0052-cc7e-43e9-b291-3c980c5496d4" containerName="authorino" containerID="cri-o://3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3" gracePeriod=30 Jul 09 20:15:17.244011 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.243939 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xjxq5" Jul 09 20:15:17.251433 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.251402 2583 generic.go:356] "Generic (PLEG): container finished" podID="7b6b0052-cc7e-43e9-b291-3c980c5496d4" containerID="3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3" exitCode=0 Jul 09 20:15:17.251615 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.251543 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xjxq5" Jul 09 20:15:17.251615 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.251578 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xjxq5" event={"ID":"7b6b0052-cc7e-43e9-b291-3c980c5496d4","Type":"ContainerDied","Data":"3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3"} Jul 09 20:15:17.251692 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.251623 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xjxq5" event={"ID":"7b6b0052-cc7e-43e9-b291-3c980c5496d4","Type":"ContainerDied","Data":"80fa3192c0fee0a74cd74adb3b1811b2d0f68af7aef968f14d701dfd3b18194c"} Jul 09 20:15:17.251692 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.251641 2583 scope.go:117] "RemoveContainer" containerID="3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3" Jul 09 20:15:17.263252 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.263227 2583 scope.go:117] "RemoveContainer" containerID="3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3" Jul 09 20:15:17.263690 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:15:17.263667 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3\": container with ID starting with 3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3 not found: ID does not exist" containerID="3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3" Jul 09 20:15:17.263802 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.263704 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3"} err="failed to get container status \"3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3\": rpc error: code = NotFound desc = could not find container \"3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3\": container with ID starting with 3c697f3ab69d429f5ff597c9bf2c8e1c683be6530aa164d9286fddee0f4fd6d3 not found: ID does not exist" Jul 09 20:15:17.308273 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.308236 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsf9j\" (UniqueName: \"kubernetes.io/projected/7b6b0052-cc7e-43e9-b291-3c980c5496d4-kube-api-access-dsf9j\") pod \"7b6b0052-cc7e-43e9-b291-3c980c5496d4\" (UID: \"7b6b0052-cc7e-43e9-b291-3c980c5496d4\") " Jul 09 20:15:17.310578 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.310533 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b6b0052-cc7e-43e9-b291-3c980c5496d4-kube-api-access-dsf9j" (OuterVolumeSpecName: "kube-api-access-dsf9j") pod "7b6b0052-cc7e-43e9-b291-3c980c5496d4" (UID: "7b6b0052-cc7e-43e9-b291-3c980c5496d4"). InnerVolumeSpecName "kube-api-access-dsf9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:15:17.408989 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.408955 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsf9j\" (UniqueName: \"kubernetes.io/projected/7b6b0052-cc7e-43e9-b291-3c980c5496d4-kube-api-access-dsf9j\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:15:17.572402 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.572359 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xjxq5"] Jul 09 20:15:17.579479 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:17.579424 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xjxq5"] Jul 09 20:15:18.096346 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:18.096309 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b6b0052-cc7e-43e9-b291-3c980c5496d4" path="/var/lib/kubelet/pods/7b6b0052-cc7e-43e9-b291-3c980c5496d4/volumes" Jul 09 20:15:21.690814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:21.690772 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:21.772656 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:21.772619 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:21.831414 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:21.831381 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:25.014940 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:25.014905 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:25.102012 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:25.101984 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:32.093386 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:32.093347 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:32.194355 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:32.194320 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:56.155991 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:56.155956 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:56.257228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:56.257190 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:57.495735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:57.495696 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:57.997997 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:57.997961 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:58.187746 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:58.187714 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:58.538003 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:58.537969 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:15:58.632972 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:15:58.632933 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:16:10.269438 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:10.269400 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:16:10.370833 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:10.370796 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:16:16.330744 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:16.330709 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:16:27.098636 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:27.098602 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:16:50.214764 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.214728 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp"] Jul 09 20:16:50.215231 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.215120 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b6b0052-cc7e-43e9-b291-3c980c5496d4" containerName="authorino" Jul 09 20:16:50.215231 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.215132 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b6b0052-cc7e-43e9-b291-3c980c5496d4" containerName="authorino" Jul 09 20:16:50.215231 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.215203 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b6b0052-cc7e-43e9-b291-3c980c5496d4" containerName="authorino" Jul 09 20:16:50.218336 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.218318 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.222725 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.222698 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 20:16:50.222889 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.222755 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2qhc4\"" Jul 09 20:16:50.222889 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.222755 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 20:16:50.223103 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.223086 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 20:16:50.229098 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.229066 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp"] Jul 09 20:16:50.243936 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.243894 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.244109 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.243968 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.244109 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.243986 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.244109 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.244004 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xlc4\" (UniqueName: \"kubernetes.io/projected/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-kube-api-access-8xlc4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.244109 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.244023 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.244109 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.244039 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.297874 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.297839 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:16:50.345056 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345019 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.345243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345095 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.345243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.345243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345149 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xlc4\" (UniqueName: \"kubernetes.io/projected/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-kube-api-access-8xlc4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.345243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.345243 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345201 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.345661 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.345807 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345657 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.345921 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.345703 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.347708 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.347680 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.347910 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.347891 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.354355 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.354325 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xlc4\" (UniqueName: \"kubernetes.io/projected/7fda8056-3c0d-4348-80d5-6e9d7cbe701f-kube-api-access-8xlc4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4j5mp\" (UID: \"7fda8056-3c0d-4348-80d5-6e9d7cbe701f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.530664 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.530545 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:16:50.687423 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.687388 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp"] Jul 09 20:16:50.689033 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:16:50.688998 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fda8056_3c0d_4348_80d5_6e9d7cbe701f.slice/crio-850ea2bc294b56eb8741999cea99fcb5c87b4f2da9ad4044aca577cf3be89063 WatchSource:0}: Error finding container 850ea2bc294b56eb8741999cea99fcb5c87b4f2da9ad4044aca577cf3be89063: Status 404 returned error can't find the container with id 850ea2bc294b56eb8741999cea99fcb5c87b4f2da9ad4044aca577cf3be89063 Jul 09 20:16:50.758540 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:50.758503 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" event={"ID":"7fda8056-3c0d-4348-80d5-6e9d7cbe701f","Type":"ContainerStarted","Data":"850ea2bc294b56eb8741999cea99fcb5c87b4f2da9ad4044aca577cf3be89063"} Jul 09 20:16:52.771098 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:52.771064 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" event={"ID":"7fda8056-3c0d-4348-80d5-6e9d7cbe701f","Type":"ContainerStarted","Data":"996fd0b6ede7ad19f064bce173262a496d840f2510bf44009f483ef62479015e"} Jul 09 20:16:52.793769 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:16:52.793715 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" podStartSLOduration=1.7091151249999998 podStartE2EDuration="2.79369848s" totalImagesPullingTime="1.084583355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:16:52.79168552 +0000 UTC m=+833.248822761" watchObservedRunningTime="2026-07-09 20:16:52.79369848 +0000 UTC m=+833.250835759" Jul 09 20:17:00.531717 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:00.531677 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:17:00.532139 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:00.531750 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:17:00.544314 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:00.544282 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:17:00.828423 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:00.828326 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4j5mp" Jul 09 20:17:05.237902 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:05.237868 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:17:13.801789 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.801755 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8"] Jul 09 20:17:13.808691 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.808657 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:13.811864 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.811834 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 20:17:13.813929 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.813901 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8"] Jul 09 20:17:13.837042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.837013 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:17:13.953115 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.953081 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:13.953295 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.953141 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcn2t\" (UniqueName: \"kubernetes.io/projected/f77b260d-f645-4e23-8533-f64f817e0b66-kube-api-access-qcn2t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:13.953295 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.953262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:13.953391 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.953296 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:13.953391 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.953336 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:13.953391 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:13.953355 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f77b260d-f645-4e23-8533-f64f817e0b66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054259 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054156 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054259 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f77b260d-f645-4e23-8533-f64f817e0b66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054259 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054233 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054567 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcn2t\" (UniqueName: \"kubernetes.io/projected/f77b260d-f645-4e23-8533-f64f817e0b66-kube-api-access-qcn2t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054567 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054350 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054567 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054633 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054733 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054707 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.054771 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.054728 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.056924 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.056902 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f77b260d-f645-4e23-8533-f64f817e0b66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.057007 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.056961 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f77b260d-f645-4e23-8533-f64f817e0b66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.062347 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.062322 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcn2t\" (UniqueName: \"kubernetes.io/projected/f77b260d-f645-4e23-8533-f64f817e0b66-kube-api-access-qcn2t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7ptm8\" (UID: \"f77b260d-f645-4e23-8533-f64f817e0b66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.121740 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.121698 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:14.269651 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.269622 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8"] Jul 09 20:17:14.270747 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:17:14.270722 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77b260d_f645_4e23_8533_f64f817e0b66.slice/crio-7b319679cb33305d3ed39225eda62bde08a1ff6dc0a8a8fef9643990180f6323 WatchSource:0}: Error finding container 7b319679cb33305d3ed39225eda62bde08a1ff6dc0a8a8fef9643990180f6323: Status 404 returned error can't find the container with id 7b319679cb33305d3ed39225eda62bde08a1ff6dc0a8a8fef9643990180f6323 Jul 09 20:17:14.895412 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.895374 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" event={"ID":"f77b260d-f645-4e23-8533-f64f817e0b66","Type":"ContainerStarted","Data":"04f91058cb997948a7e46797d17049e43b584116b331a47e43759fd2e25f5116"} Jul 09 20:17:14.896008 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.895427 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" event={"ID":"f77b260d-f645-4e23-8533-f64f817e0b66","Type":"ContainerStarted","Data":"7b319679cb33305d3ed39225eda62bde08a1ff6dc0a8a8fef9643990180f6323"} Jul 09 20:17:14.914351 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:14.914294 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" podStartSLOduration=1.716342451 podStartE2EDuration="1.914274871s" totalImagesPullingTime="197.93242ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:17:14.913746151 +0000 UTC m=+855.370883391" watchObservedRunningTime="2026-07-09 20:17:14.914274871 +0000 UTC m=+855.371412112" Jul 09 20:17:19.732468 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:19.732416 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:17:24.122439 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:24.122403 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:24.122981 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:24.122495 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:24.134992 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:24.134968 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:17:24.969064 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:17:24.969036 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7ptm8" Jul 09 20:18:04.852625 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:18:04.852586 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:18:04.855127 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:18:04.853631 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:18:12.995677 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:18:12.995638 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:18:26.230521 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:18:26.230479 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:18:26.334480 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:18:26.334427 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:18:27.454478 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:18:27.454430 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:18:27.553754 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:18:27.553718 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:18:30.084669 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:18:30.084640 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:19:38.410641 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:19:38.410608 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:19:40.177326 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:19:40.177291 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:23.602097 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:23.602043 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:23.698565 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:23.698532 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:23.813532 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:23.813495 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:29.579589 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:29.579529 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:29.688737 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:29.688699 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:29.780961 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:29.780925 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:29.951352 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:29.951312 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:35.927502 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:35.927401 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:36.028060 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:36.028020 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:20:59.029098 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:20:59.029010 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:21:39.840232 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:21:39.840188 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:22:16.344686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:22:16.344632 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:22:16.444879 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:22:16.444843 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:23:04.901921 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:23:04.901890 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:23:04.904303 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:23:04.904034 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:24:28.479696 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:28.479652 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:24:29.634059 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:29.634024 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd"] Jul 09 20:24:29.634520 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:29.634243 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" podUID="64818c3a-376f-4d8d-bcab-e036279fe1f4" containerName="manager" containerID="cri-o://d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7" gracePeriod=10 Jul 09 20:24:32.604419 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:32.604386 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:24:32.715899 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:32.715858 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cspn2\" (UniqueName: \"kubernetes.io/projected/64818c3a-376f-4d8d-bcab-e036279fe1f4-kube-api-access-cspn2\") pod \"64818c3a-376f-4d8d-bcab-e036279fe1f4\" (UID: \"64818c3a-376f-4d8d-bcab-e036279fe1f4\") " Jul 09 20:24:32.716121 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:32.715974 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64818c3a-376f-4d8d-bcab-e036279fe1f4-extensions-socket-volume\") pod \"64818c3a-376f-4d8d-bcab-e036279fe1f4\" (UID: \"64818c3a-376f-4d8d-bcab-e036279fe1f4\") " Jul 09 20:24:32.716359 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:32.716327 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64818c3a-376f-4d8d-bcab-e036279fe1f4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "64818c3a-376f-4d8d-bcab-e036279fe1f4" (UID: "64818c3a-376f-4d8d-bcab-e036279fe1f4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 20:24:32.718330 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:32.718300 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64818c3a-376f-4d8d-bcab-e036279fe1f4-kube-api-access-cspn2" (OuterVolumeSpecName: "kube-api-access-cspn2") pod "64818c3a-376f-4d8d-bcab-e036279fe1f4" (UID: "64818c3a-376f-4d8d-bcab-e036279fe1f4"). InnerVolumeSpecName "kube-api-access-cspn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:24:32.817039 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:32.816986 2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64818c3a-376f-4d8d-bcab-e036279fe1f4-extensions-socket-volume\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:24:32.817039 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:32.817031 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cspn2\" (UniqueName: \"kubernetes.io/projected/64818c3a-376f-4d8d-bcab-e036279fe1f4-kube-api-access-cspn2\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:24:33.376487 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.376427 2583 generic.go:356] "Generic (PLEG): container finished" podID="64818c3a-376f-4d8d-bcab-e036279fe1f4" containerID="d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7" exitCode=0 Jul 09 20:24:33.376487 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.376480 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" event={"ID":"64818c3a-376f-4d8d-bcab-e036279fe1f4","Type":"ContainerDied","Data":"d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7"} Jul 09 20:24:33.376698 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.376534 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" event={"ID":"64818c3a-376f-4d8d-bcab-e036279fe1f4","Type":"ContainerDied","Data":"8d6e26e5a7418aed4d161db4981145269acbcfe66e543e57189595f664a1ce79"} Jul 09 20:24:33.376698 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.376555 2583 scope.go:117] "RemoveContainer" containerID="d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7" Jul 09 20:24:33.376698 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.376492 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd" Jul 09 20:24:33.387089 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.387070 2583 scope.go:117] "RemoveContainer" containerID="d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7" Jul 09 20:24:33.387395 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:24:33.387376 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7\": container with ID starting with d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7 not found: ID does not exist" containerID="d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7" Jul 09 20:24:33.387464 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.387408 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7"} err="failed to get container status \"d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7\": rpc error: code = NotFound desc = could not find container \"d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7\": container with ID starting with d1c15a48805a0ce0a1b75b366ebff7499f1f422d9e2a87d7e3a0e23d53d0dce7 not found: ID does not exist" Jul 09 20:24:33.400240 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.400211 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd"] Jul 09 20:24:33.406171 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:33.406138 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9c9fd"] Jul 09 20:24:34.096553 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:34.096512 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64818c3a-376f-4d8d-bcab-e036279fe1f4" path="/var/lib/kubelet/pods/64818c3a-376f-4d8d-bcab-e036279fe1f4/volumes" Jul 09 20:24:55.602952 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:24:55.602914 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:25:30.804853 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.804812 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c"] Jul 09 20:25:30.805295 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.805237 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64818c3a-376f-4d8d-bcab-e036279fe1f4" containerName="manager" Jul 09 20:25:30.805295 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.805250 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="64818c3a-376f-4d8d-bcab-e036279fe1f4" containerName="manager" Jul 09 20:25:30.805367 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.805350 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="64818c3a-376f-4d8d-bcab-e036279fe1f4" containerName="manager" Jul 09 20:25:30.808411 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.808394 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:30.811118 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.811095 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-btptb\"" Jul 09 20:25:30.819204 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.819177 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c"] Jul 09 20:25:30.934279 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.934239 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417e-4df5-408c-9225-1f20f49b2e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfd5c\" (UID: \"f3ec417e-4df5-408c-9225-1f20f49b2e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:30.934508 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:30.934297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb2nf\" (UniqueName: \"kubernetes.io/projected/f3ec417e-4df5-408c-9225-1f20f49b2e64-kube-api-access-wb2nf\") pod \"kuadrant-operator-controller-manager-86878c769f-rfd5c\" (UID: \"f3ec417e-4df5-408c-9225-1f20f49b2e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:31.035296 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.035246 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2nf\" (UniqueName: \"kubernetes.io/projected/f3ec417e-4df5-408c-9225-1f20f49b2e64-kube-api-access-wb2nf\") pod \"kuadrant-operator-controller-manager-86878c769f-rfd5c\" (UID: \"f3ec417e-4df5-408c-9225-1f20f49b2e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:31.035589 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.035478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417e-4df5-408c-9225-1f20f49b2e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfd5c\" (UID: \"f3ec417e-4df5-408c-9225-1f20f49b2e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:31.035866 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.035847 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3ec417e-4df5-408c-9225-1f20f49b2e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfd5c\" (UID: \"f3ec417e-4df5-408c-9225-1f20f49b2e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:31.044169 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.044141 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb2nf\" (UniqueName: \"kubernetes.io/projected/f3ec417e-4df5-408c-9225-1f20f49b2e64-kube-api-access-wb2nf\") pod \"kuadrant-operator-controller-manager-86878c769f-rfd5c\" (UID: \"f3ec417e-4df5-408c-9225-1f20f49b2e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:31.121535 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.121427 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:31.288825 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.288790 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c"] Jul 09 20:25:31.292337 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:25:31.292299 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ec417e_4df5_408c_9225_1f20f49b2e64.slice/crio-da77375475bb6c79f44a978800aaabbc023868165155cc779c43d4f3e2c1b220 WatchSource:0}: Error finding container da77375475bb6c79f44a978800aaabbc023868165155cc779c43d4f3e2c1b220: Status 404 returned error can't find the container with id da77375475bb6c79f44a978800aaabbc023868165155cc779c43d4f3e2c1b220 Jul 09 20:25:31.707017 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.706976 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" event={"ID":"f3ec417e-4df5-408c-9225-1f20f49b2e64","Type":"ContainerStarted","Data":"4f5989c722e772446cc1cdb38fcfc173c2de2d155ef43130a262b52f6e961cbb"} Jul 09 20:25:31.707196 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.707045 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:25:31.707196 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.707070 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" event={"ID":"f3ec417e-4df5-408c-9225-1f20f49b2e64","Type":"ContainerStarted","Data":"da77375475bb6c79f44a978800aaabbc023868165155cc779c43d4f3e2c1b220"} Jul 09 20:25:31.729900 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:31.729847 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" podStartSLOduration=1.729830702 podStartE2EDuration="1.729830702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:25:31.72686301 +0000 UTC m=+1352.184000249" watchObservedRunningTime="2026-07-09 20:25:31.729830702 +0000 UTC m=+1352.186967942" Jul 09 20:25:42.715119 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:25:42.715084 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfd5c" Jul 09 20:28:04.939149 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:28:04.939029 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:28:04.943144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:28:04.941834 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:29:18.255804 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:29:18.255772 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:29:18.308769 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:29:18.308737 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:29:33.412703 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:29:33.412669 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:30:24.367355 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:30:24.367272 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:31:32.204136 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:31:32.204102 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:31:39.486689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:31:39.486635 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:31:47.766440 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:31:47.766402 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:31:52.909782 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:31:52.909717 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:31:55.906854 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:31:55.906819 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:31:56.011545 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:31:56.011505 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:31:56.375589 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:31:56.375442 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:03.141827 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:03.141795 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:03.252237 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:03.252191 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:03.432568 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:03.432433 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:03.530814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:03.530776 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:04.560794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:04.560760 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:04.664902 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:04.664866 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:04.831062 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:04.830974 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:05.120534 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:05.120419 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:05.541171 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:05.541139 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:05.638856 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:05.638820 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:07.322014 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:07.321981 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:09.759804 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:09.759767 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:09.904785 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:09.904751 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:10.018898 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:10.018799 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:10.129163 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:10.129131 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:13.351909 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:13.351875 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:15.731716 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:15.731677 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:15.835156 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:15.835107 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:15.956198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:15.956164 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:16.057041 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:16.056917 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:17.083074 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:17.083023 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:17.192206 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:17.192170 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:17.357849 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:17.357765 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:17.564155 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:17.564116 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:17.963166 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:17.963133 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:18.063401 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:18.063360 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:19.319928 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:19.319896 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:22.295814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:22.295781 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:22.673714 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:22.673680 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:28.458140 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:28.458096 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:28.571230 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:28.571174 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:32.789186 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:32.789149 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:34.475377 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:34.475341 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:34.576768 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:34.576732 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:34.676392 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:34.676350 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:34.741325 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:34.741232 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:35.780955 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:35.780923 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:35.859806 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:35.859774 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:35.925086 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:35.925049 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:36.025637 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:36.025609 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:36.373262 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:36.373223 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:36.474820 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:36.474788 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:38.247126 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:38.247096 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:40.289081 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:40.289046 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:40.595351 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:40.595259 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:40.700515 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:40.700474 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:40.851812 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:40.851723 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:42.196168 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:42.196125 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:46.425634 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:46.425597 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:46.509512 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:46.509479 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:46.925212 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:46.925170 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:47.023656 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:47.023612 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:47.124868 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:47.124833 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:48.557327 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:48.557298 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:54.482428 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:54.482340 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:54.590909 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:54.590875 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:54.684475 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:54.684417 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:54.790600 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:54.790382 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:32:55.231158 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:32:55.231118 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:04.977120 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:04.976988 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:33:04.981236 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:04.981216 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:33:21.227569 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:21.227531 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:27.148161 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:27.148123 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:27.241202 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:27.241150 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:27.340389 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:27.340336 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:43.310865 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:43.310829 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:49.037136 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:49.037092 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:49.139211 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:49.139166 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:49.236737 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:49.236701 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:33:59.755396 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:33:59.755352 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:00.565598 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:00.565558 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:06.393273 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:06.393233 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:06.460396 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:06.460349 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:06.549009 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:06.548968 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:06.645301 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:06.645211 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:06.745940 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:06.745906 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:07.534094 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:07.534058 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:07.637312 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:07.637276 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:07.737509 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:07.737481 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:09.372310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:09.372274 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:15.115856 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:15.115813 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:15.193199 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:15.193164 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:15.797194 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:15.797162 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:21.467819 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:21.467723 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:21.534578 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:21.534541 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:21.717998 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:21.717917 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:22.053057 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:22.052960 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:22.186220 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:22.186179 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:25.412634 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:25.412588 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:25.489229 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:25.489196 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:25.548567 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:25.548536 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:25.906780 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:25.906731 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:26.007329 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:26.007293 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:26.108552 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:26.108514 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:29.963334 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:29.963297 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:30.633414 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:30.633382 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:30.737111 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:30.737049 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:31.088111 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:31.088008 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:36.824775 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:36.824738 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:36.923660 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:36.923629 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:37.290942 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:37.290909 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:37.744417 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:37.744383 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:37.807071 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:37.807031 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:41.840552 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:41.840513 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:43.412043 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:43.412001 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:43.472992 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:43.472964 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:43.678626 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:43.678536 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:43.905991 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:43.905954 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:44.042863 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:44.042777 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:44.140198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:44.140163 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:44.262429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:44.262398 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:50.002262 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:50.002218 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:50.103646 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:50.103607 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:50.203240 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:50.203202 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:50.343930 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:50.343841 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:56.027413 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:56.027369 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:34:56.128964 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:34:56.128931 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:01.480237 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:01.480197 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:01.581431 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:01.581381 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:02.840698 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:02.840668 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:03.136126 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:03.136101 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:03.514927 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:03.514836 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:05.704101 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:05.704060 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:05.803292 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:05.803260 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:06.088888 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:06.088800 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:06.180048 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:06.180016 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:06.485684 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:06.485641 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:06.587381 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:06.587343 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:10.131666 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:10.131635 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:19.245654 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:19.245623 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:52.796198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:52.796102 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:53.987695 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:53.987652 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:35:58.885894 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:35:58.885853 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:03.915228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:03.915191 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:40.589908 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:40.589846 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:40.895905 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:40.895866 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:46.351005 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:46.350968 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:46.407374 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:46.407336 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:46.840086 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:46.840041 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:47.159039 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:47.159004 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:48.831371 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:48.831336 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:48.952095 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:48.952041 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:49.042586 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:49.042536 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:50.239468 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:50.239404 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:50.338430 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:50.338397 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:50.542396 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:50.542270 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:52.351078 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:52.351040 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:58.001652 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:58.001620 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:58.098771 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:58.098739 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:36:58.680373 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:36:58.680332 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:04.495924 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:04.495881 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:04.667951 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:04.667918 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:04.758072 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:04.757988 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:13.782945 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:13.782909 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:13.884268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:13.884234 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:15.234570 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:15.234537 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:15.590588 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:15.590492 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:20.287302 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:20.287269 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:20.388513 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:20.388485 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:36.566041 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:36.566003 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:42.175131 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:42.175089 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:42.277068 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:42.277034 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:42.486426 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:42.486327 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:42.809610 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:42.809518 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:43.380832 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:43.380801 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:45.351272 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:45.351243 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:45.431299 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:45.431265 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:45.501207 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:45.501176 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:45.759611 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:45.759573 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:46.189888 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:46.189852 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:46.289691 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:46.289646 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:49.864537 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:49.864502 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:50.197565 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:50.197526 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:50.492736 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:50.492652 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:50.726018 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:50.725966 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:53.398126 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:53.398088 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:53.502370 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:53.502336 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:53.599277 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:53.599243 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:53.975076 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:53.975040 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:54.262064 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:54.261962 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:54.388127 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:54.388091 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:37:57.870338 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:37:57.870304 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:05.016115 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:05.015991 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:38:05.023385 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:05.023360 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:38:06.726189 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:06.726137 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:07.017432 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:07.017338 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:07.120352 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:07.120308 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:15.052728 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:15.052683 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:15.152871 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:15.152836 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:35.442674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:35.442637 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:56.367410 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:56.367335 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:57.333186 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:57.333152 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:57.500622 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:57.500590 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:57.894872 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:57.894840 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:57.995573 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:57.995539 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:38:58.157703 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:38:58.157623 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:03.069387 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:03.069320 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:39.698673 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:39.698632 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:39.984150 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:39.984063 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:40.202686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:40.202648 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:40.368734 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:40.368642 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:40.845511 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:40.845472 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:40.941516 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:40.941485 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:41.041260 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:41.041232 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:41.158428 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:41.158399 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:46.597990 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:46.597954 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:46.698363 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:46.698332 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:46.806225 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:46.806189 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:47.035830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:47.035794 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:47.375675 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:47.375586 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:47.694330 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:47.694295 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:48.185803 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:48.185775 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:50.895890 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:50.895855 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:50.971674 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:50.971650 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:51.139313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:51.139281 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:51.285657 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:51.285576 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:51.539696 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:51.539610 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:51.644676 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:51.644639 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:55.430113 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:55.430078 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:55.903282 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:55.903248 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:56.223780 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:56.223699 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:56.325101 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:56.325063 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:58.966993 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:58.966961 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:59.047136 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:59.047102 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:59.196099 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:59.196071 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:59.300855 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:59.300769 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:59.757203 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:59.757166 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:39:59.857647 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:39:59.857615 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:02.181462 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:02.181424 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:02.283683 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:02.283648 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:03.495011 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:03.494977 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:11.637818 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:11.637781 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:12.066318 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:12.066224 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:12.269007 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:12.268975 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:12.368481 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:12.368341 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:12.554100 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:12.554064 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:17.785368 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:17.785332 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:17.906128 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:17.906094 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:18.072071 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:18.071955 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:18.297438 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:18.297408 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:18.457706 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:18.457669 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:18.867351 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:18.867269 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:19.036911 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:19.036861 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:19.137860 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:19.137828 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:19.273366 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:19.273340 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:25.030357 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:25.030271 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:25.128378 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:25.128341 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:25.303217 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:25.303116 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:25.545196 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:25.545163 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:25.902615 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:25.902569 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:26.212351 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:26.212260 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:26.314777 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:26.314738 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:29.194196 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:29.194165 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:29.286954 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:29.286925 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:29.388272 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:29.388238 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:29.742218 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:29.742185 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:29.842994 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:29.842959 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:29.943130 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:29.943098 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:33.672075 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:33.672043 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:34.096643 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:34.096556 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:34.310902 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:34.310865 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:34.442014 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:34.441969 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:37.219815 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:37.219776 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:37.308699 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:37.308672 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:37.375268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:37.375225 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:37.621797 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:37.621704 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:37.755960 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:37.755927 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:37.858724 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:37.858689 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:41.727917 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:41.727886 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:50.675959 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:50.675920 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:50.776495 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:50.776436 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:40:59.356745 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:40:59.356694 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:41:00.769284 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:41:00.769249 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:41:05.834513 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:41:05.834476 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:41:26.743100 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:41:26.743058 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:41:36.153241 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:41:36.153204 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:42:26.668204 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:42:26.668171 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:43:05.058781 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:43:05.058661 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:43:05.065357 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:43:05.065334 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjzpj_7250d077-6ea3-4eba-b703-558f2ceffe18/ovn-acl-logging/0.log" Jul 09 20:43:38.395754 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:43:38.395714 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:43:39.324821 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:43:39.324787 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:43:48.630097 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:43:48.630000 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:43:54.657012 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:43:54.656966 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:44:21.341664 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:44:21.341631 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:44:36.256277 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:44:36.256239 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:44:36.307144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:44:36.307107 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:00.141325 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.141224 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn"] Jul 09 20:45:00.145101 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.145079 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98"] Jul 09 20:45:00.145216 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.145194 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" Jul 09 20:45:00.147754 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.147725 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qk7hz\"" Jul 09 20:45:00.147901 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.147754 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 20:45:00.147971 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.147933 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 20:45:00.148645 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.148621 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws"] Jul 09 20:45:00.148771 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.148740 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" Jul 09 20:45:00.155341 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.155309 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" Jul 09 20:45:00.155565 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.155548 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn"] Jul 09 20:45:00.159649 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.159613 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98"] Jul 09 20:45:00.165073 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.165045 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws"] Jul 09 20:45:00.249400 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.249360 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7v2z\" (UniqueName: \"kubernetes.io/projected/f57c2a1f-19e4-4fcf-ae69-948550656b33-kube-api-access-p7v2z\") pod \"maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws\" (UID: \"f57c2a1f-19e4-4fcf-ae69-948550656b33\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" Jul 09 20:45:00.249625 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.249564 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmpzh\" (UniqueName: \"kubernetes.io/projected/d5d688dc-4ff6-41c2-af31-3fa36905efe9-kube-api-access-hmpzh\") pod \"maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn\" (UID: \"d5d688dc-4ff6-41c2-af31-3fa36905efe9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" Jul 09 20:45:00.249625 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.249600 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7trlc\" (UniqueName: \"kubernetes.io/projected/ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb-kube-api-access-7trlc\") pod \"maas-api-key-cleanup-29727165-2jz98\" (UID: \"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" Jul 09 20:45:00.350966 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.350929 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmpzh\" (UniqueName: \"kubernetes.io/projected/d5d688dc-4ff6-41c2-af31-3fa36905efe9-kube-api-access-hmpzh\") pod \"maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn\" (UID: \"d5d688dc-4ff6-41c2-af31-3fa36905efe9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" Jul 09 20:45:00.350966 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.350968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trlc\" (UniqueName: \"kubernetes.io/projected/ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb-kube-api-access-7trlc\") pod \"maas-api-key-cleanup-29727165-2jz98\" (UID: \"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" Jul 09 20:45:00.351233 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.350992 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7v2z\" (UniqueName: \"kubernetes.io/projected/f57c2a1f-19e4-4fcf-ae69-948550656b33-kube-api-access-p7v2z\") pod \"maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws\" (UID: \"f57c2a1f-19e4-4fcf-ae69-948550656b33\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" Jul 09 20:45:00.359529 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.359499 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7v2z\" (UniqueName: \"kubernetes.io/projected/f57c2a1f-19e4-4fcf-ae69-948550656b33-kube-api-access-p7v2z\") pod \"maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws\" (UID: \"f57c2a1f-19e4-4fcf-ae69-948550656b33\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" Jul 09 20:45:00.359676 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.359652 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmpzh\" (UniqueName: \"kubernetes.io/projected/d5d688dc-4ff6-41c2-af31-3fa36905efe9-kube-api-access-hmpzh\") pod \"maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn\" (UID: \"d5d688dc-4ff6-41c2-af31-3fa36905efe9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" Jul 09 20:45:00.359753 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.359733 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7trlc\" (UniqueName: \"kubernetes.io/projected/ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb-kube-api-access-7trlc\") pod \"maas-api-key-cleanup-29727165-2jz98\" (UID: \"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" Jul 09 20:45:00.462144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.462039 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" Jul 09 20:45:00.471935 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.471905 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" Jul 09 20:45:00.480024 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.479986 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" Jul 09 20:45:00.644299 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.644266 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn"] Jul 09 20:45:00.645850 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:45:00.645817 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d688dc_4ff6_41c2_af31_3fa36905efe9.slice/crio-5572d751810a333da6eafbbfa8d50fe42772cc831ed8901be33514f1b3713f7c WatchSource:0}: Error finding container 5572d751810a333da6eafbbfa8d50fe42772cc831ed8901be33514f1b3713f7c: Status 404 returned error can't find the container with id 5572d751810a333da6eafbbfa8d50fe42772cc831ed8901be33514f1b3713f7c Jul 09 20:45:00.648231 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.648205 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 20:45:00.886293 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.886221 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98"] Jul 09 20:45:00.887922 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:45:00.887889 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1a6bbb_e837_4d20_947b_ceaeebe1f1eb.slice/crio-5a956c61ded045aa6c313963357efd98f873bb1b4792ddad266b95591ac83ed7 WatchSource:0}: Error finding container 5a956c61ded045aa6c313963357efd98f873bb1b4792ddad266b95591ac83ed7: Status 404 returned error can't find the container with id 5a956c61ded045aa6c313963357efd98f873bb1b4792ddad266b95591ac83ed7 Jul 09 20:45:00.889662 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:00.889639 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws"] Jul 09 20:45:00.889957 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:45:00.889934 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57c2a1f_19e4_4fcf_ae69_948550656b33.slice/crio-4a5c98d94e08633b6d614e8f41400df3f0da59ce5edd0323691109a2a32468b1 WatchSource:0}: Error finding container 4a5c98d94e08633b6d614e8f41400df3f0da59ce5edd0323691109a2a32468b1: Status 404 returned error can't find the container with id 4a5c98d94e08633b6d614e8f41400df3f0da59ce5edd0323691109a2a32468b1 Jul 09 20:45:01.241844 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:01.241723 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" event={"ID":"f57c2a1f-19e4-4fcf-ae69-948550656b33","Type":"ContainerStarted","Data":"4a5c98d94e08633b6d614e8f41400df3f0da59ce5edd0323691109a2a32468b1"} Jul 09 20:45:01.242965 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:01.242924 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" event={"ID":"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb","Type":"ContainerStarted","Data":"5a956c61ded045aa6c313963357efd98f873bb1b4792ddad266b95591ac83ed7"} Jul 09 20:45:01.244104 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:01.244077 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" event={"ID":"d5d688dc-4ff6-41c2-af31-3fa36905efe9","Type":"ContainerStarted","Data":"5572d751810a333da6eafbbfa8d50fe42772cc831ed8901be33514f1b3713f7c"} Jul 09 20:45:02.159441 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:02.159406 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:02.876070 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:02.876034 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:02.979028 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:02.978977 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:03.414687 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:03.414657 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:04.265808 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:04.265769 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" event={"ID":"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb","Type":"ContainerStarted","Data":"efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931"} Jul 09 20:45:04.267524 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:04.267496 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" event={"ID":"f57c2a1f-19e4-4fcf-ae69-948550656b33","Type":"ContainerStarted","Data":"9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332"} Jul 09 20:45:04.281804 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:04.281761 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" podStartSLOduration=1.972863714 podStartE2EDuration="4.281746541s" totalImagesPullingTime="2.308882827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:45:04.280120189 +0000 UTC m=+2524.737257430" watchObservedRunningTime="2026-07-09 20:45:04.281746541 +0000 UTC m=+2524.738883840" Jul 09 20:45:04.295859 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:04.295810 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" podStartSLOduration=1.993598899 podStartE2EDuration="4.295793826s" totalImagesPullingTime="2.302194927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:45:04.293185992 +0000 UTC m=+2524.750323232" watchObservedRunningTime="2026-07-09 20:45:04.295793826 +0000 UTC m=+2524.752931079" Jul 09 20:45:08.443181 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:08.443138 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:11.459373 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:11.459342 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:18.347596 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:18.347555 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" event={"ID":"d5d688dc-4ff6-41c2-af31-3fa36905efe9","Type":"ContainerStarted","Data":"93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148"} Jul 09 20:45:18.364085 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:18.364033 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" podStartSLOduration=1.048739262 podStartE2EDuration="18.364016906s" totalImagesPullingTime="17.315277644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:45:18.361672533 +0000 UTC m=+2538.818809774" watchObservedRunningTime="2026-07-09 20:45:18.364016906 +0000 UTC m=+2538.821154163" Jul 09 20:45:34.437895 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:34.437850 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:51.348111 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:51.348062 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:51.445439 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:51.445406 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:56.822745 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:56.822710 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:45:56.923209 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:45:56.923159 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:00.014145 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:00.014103 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98"] Jul 09 20:46:00.014579 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:00.014363 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" podUID="ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb" containerName="cleanup" containerID="cri-o://efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931" gracePeriod=30 Jul 09 20:46:00.016743 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:00.016724 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn"] Jul 09 20:46:00.016943 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:00.016922 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" podUID="d5d688dc-4ff6-41c2-af31-3fa36905efe9" containerName="cleanup" containerID="cri-o://93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148" gracePeriod=30 Jul 09 20:46:00.018860 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:00.018833 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:00.019805 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:00.019781 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws"] Jul 09 20:46:00.019978 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:00.019945 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" podUID="f57c2a1f-19e4-4fcf-ae69-948550656b33" containerName="cleanup" containerID="cri-o://9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332" gracePeriod=30 Jul 09 20:46:00.152258 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:00.152202 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:24.627825 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:24.627721 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:26.013814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.013782 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:26.572395 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.572359 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7310-140396085832752"] Jul 09 20:46:26.575984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.575967 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396085832752" Jul 09 20:46:26.578571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.578547 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-p45sw\"" Jul 09 20:46:26.579662 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.579638 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396085832752"] Jul 09 20:46:26.673008 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.672969 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4wdh\" (UniqueName: \"kubernetes.io/projected/fd75ad26-d2b3-4d07-b165-3655c9e1af41-kube-api-access-d4wdh\") pod \"test-curl-7310-140396085832752\" (UID: \"fd75ad26-d2b3-4d07-b165-3655c9e1af41\") " pod="openshift-ingress/test-curl-7310-140396085832752" Jul 09 20:46:26.774185 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.774145 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4wdh\" (UniqueName: \"kubernetes.io/projected/fd75ad26-d2b3-4d07-b165-3655c9e1af41-kube-api-access-d4wdh\") pod \"test-curl-7310-140396085832752\" (UID: \"fd75ad26-d2b3-4d07-b165-3655c9e1af41\") " pod="openshift-ingress/test-curl-7310-140396085832752" Jul 09 20:46:26.782696 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.782670 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4wdh\" (UniqueName: \"kubernetes.io/projected/fd75ad26-d2b3-4d07-b165-3655c9e1af41-kube-api-access-d4wdh\") pod \"test-curl-7310-140396085832752\" (UID: \"fd75ad26-d2b3-4d07-b165-3655c9e1af41\") " pod="openshift-ingress/test-curl-7310-140396085832752" Jul 09 20:46:26.886488 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:26.886424 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396085832752" Jul 09 20:46:27.027475 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:27.027430 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396085832752"] Jul 09 20:46:27.029926 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:46:27.029900 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd75ad26_d2b3_4d07_b165_3655c9e1af41.slice/crio-134c37a88edb19e6d51a180853dafc7a1ca1c769bd0213a21e6d308322bec140 WatchSource:0}: Error finding container 134c37a88edb19e6d51a180853dafc7a1ca1c769bd0213a21e6d308322bec140: Status 404 returned error can't find the container with id 134c37a88edb19e6d51a180853dafc7a1ca1c769bd0213a21e6d308322bec140 Jul 09 20:46:27.753198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:27.753171 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396085832752" event={"ID":"fd75ad26-d2b3-4d07-b165-3655c9e1af41","Type":"ContainerStarted","Data":"134c37a88edb19e6d51a180853dafc7a1ca1c769bd0213a21e6d308322bec140"} Jul 09 20:46:28.760622 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:28.760588 2583 generic.go:356] "Generic (PLEG): container finished" podID="fd75ad26-d2b3-4d07-b165-3655c9e1af41" containerID="ab6d56459d29e6db8201355f92998cf7f3a4b9f4161080289c661b6413b3b70e" exitCode=0 Jul 09 20:46:28.761027 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:28.760681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396085832752" event={"ID":"fd75ad26-d2b3-4d07-b165-3655c9e1af41","Type":"ContainerDied","Data":"ab6d56459d29e6db8201355f92998cf7f3a4b9f4161080289c661b6413b3b70e"} Jul 09 20:46:29.913114 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:29.913085 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396085832752" Jul 09 20:46:29.932590 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:29.932561 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7310-140396085832752_fd75ad26-d2b3-4d07-b165-3655c9e1af41/test-curl-7310-140396085832752/0.log" Jul 09 20:46:29.957301 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:29.957256 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7310-140396085832752"] Jul 09 20:46:29.961162 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:29.961130 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7310-140396085832752"] Jul 09 20:46:30.006758 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.006719 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4wdh\" (UniqueName: \"kubernetes.io/projected/fd75ad26-d2b3-4d07-b165-3655c9e1af41-kube-api-access-d4wdh\") pod \"fd75ad26-d2b3-4d07-b165-3655c9e1af41\" (UID: \"fd75ad26-d2b3-4d07-b165-3655c9e1af41\") " Jul 09 20:46:30.009113 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.009087 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd75ad26-d2b3-4d07-b165-3655c9e1af41-kube-api-access-d4wdh" (OuterVolumeSpecName: "kube-api-access-d4wdh") pod "fd75ad26-d2b3-4d07-b165-3655c9e1af41" (UID: "fd75ad26-d2b3-4d07-b165-3655c9e1af41"). InnerVolumeSpecName "kube-api-access-d4wdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:46:30.108902 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.108820 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4wdh\" (UniqueName: \"kubernetes.io/projected/fd75ad26-d2b3-4d07-b165-3655c9e1af41-kube-api-access-d4wdh\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:46:30.112611 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.112562 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd75ad26-d2b3-4d07-b165-3655c9e1af41" path="/var/lib/kubelet/pods/fd75ad26-d2b3-4d07-b165-3655c9e1af41/volumes" Jul 09 20:46:30.113857 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.113833 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7310-140396085830448"] Jul 09 20:46:30.114731 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.114706 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd75ad26-d2b3-4d07-b165-3655c9e1af41" containerName="test-curl-7310-140396085832752" Jul 09 20:46:30.114893 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.114879 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd75ad26-d2b3-4d07-b165-3655c9e1af41" containerName="test-curl-7310-140396085832752" Jul 09 20:46:30.115198 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.115102 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd75ad26-d2b3-4d07-b165-3655c9e1af41" containerName="test-curl-7310-140396085832752" Jul 09 20:46:30.120468 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.119039 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396085830448"] Jul 09 20:46:30.120468 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.119171 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396085830448" Jul 09 20:46:30.210235 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.210173 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmrz\" (UniqueName: \"kubernetes.io/projected/3370588c-7af2-4e3c-81b8-6af1ee074a2b-kube-api-access-mqmrz\") pod \"test-curl-7310-140396085830448\" (UID: \"3370588c-7af2-4e3c-81b8-6af1ee074a2b\") " pod="openshift-ingress/test-curl-7310-140396085830448" Jul 09 20:46:30.232924 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.232891 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" Jul 09 20:46:30.274760 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.274677 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" Jul 09 20:46:30.284504 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.284478 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" Jul 09 20:46:30.311649 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.311619 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7v2z\" (UniqueName: \"kubernetes.io/projected/f57c2a1f-19e4-4fcf-ae69-948550656b33-kube-api-access-p7v2z\") pod \"f57c2a1f-19e4-4fcf-ae69-948550656b33\" (UID: \"f57c2a1f-19e4-4fcf-ae69-948550656b33\") " Jul 09 20:46:30.311817 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.311722 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7trlc\" (UniqueName: \"kubernetes.io/projected/ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb-kube-api-access-7trlc\") pod \"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb\" (UID: \"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb\") " Jul 09 20:46:30.311898 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.311867 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmrz\" (UniqueName: \"kubernetes.io/projected/3370588c-7af2-4e3c-81b8-6af1ee074a2b-kube-api-access-mqmrz\") pod \"test-curl-7310-140396085830448\" (UID: \"3370588c-7af2-4e3c-81b8-6af1ee074a2b\") " pod="openshift-ingress/test-curl-7310-140396085830448" Jul 09 20:46:30.314020 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.313984 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57c2a1f-19e4-4fcf-ae69-948550656b33-kube-api-access-p7v2z" (OuterVolumeSpecName: "kube-api-access-p7v2z") pod "f57c2a1f-19e4-4fcf-ae69-948550656b33" (UID: "f57c2a1f-19e4-4fcf-ae69-948550656b33"). InnerVolumeSpecName "kube-api-access-p7v2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:46:30.314020 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.313991 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb-kube-api-access-7trlc" (OuterVolumeSpecName: "kube-api-access-7trlc") pod "ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb" (UID: "ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb"). InnerVolumeSpecName "kube-api-access-7trlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:46:30.319866 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.319834 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmrz\" (UniqueName: \"kubernetes.io/projected/3370588c-7af2-4e3c-81b8-6af1ee074a2b-kube-api-access-mqmrz\") pod \"test-curl-7310-140396085830448\" (UID: \"3370588c-7af2-4e3c-81b8-6af1ee074a2b\") " pod="openshift-ingress/test-curl-7310-140396085830448" Jul 09 20:46:30.413225 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.413184 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmpzh\" (UniqueName: \"kubernetes.io/projected/d5d688dc-4ff6-41c2-af31-3fa36905efe9-kube-api-access-hmpzh\") pod \"d5d688dc-4ff6-41c2-af31-3fa36905efe9\" (UID: \"d5d688dc-4ff6-41c2-af31-3fa36905efe9\") " Jul 09 20:46:30.413414 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.413403 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7trlc\" (UniqueName: \"kubernetes.io/projected/ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb-kube-api-access-7trlc\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:46:30.413474 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.413416 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7v2z\" (UniqueName: \"kubernetes.io/projected/f57c2a1f-19e4-4fcf-ae69-948550656b33-kube-api-access-p7v2z\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:46:30.415397 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.415363 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d688dc-4ff6-41c2-af31-3fa36905efe9-kube-api-access-hmpzh" (OuterVolumeSpecName: "kube-api-access-hmpzh") pod "d5d688dc-4ff6-41c2-af31-3fa36905efe9" (UID: "d5d688dc-4ff6-41c2-af31-3fa36905efe9"). InnerVolumeSpecName "kube-api-access-hmpzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:46:30.485915 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.485873 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396085830448" Jul 09 20:46:30.514402 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.514362 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmpzh\" (UniqueName: \"kubernetes.io/projected/d5d688dc-4ff6-41c2-af31-3fa36905efe9-kube-api-access-hmpzh\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:46:30.643380 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.643355 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396085830448"] Jul 09 20:46:30.645082 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:46:30.645052 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3370588c_7af2_4e3c_81b8_6af1ee074a2b.slice/crio-2da64431be08b596bd3ae565ab3ae0c10875e81da673ca7a62a18fe200fd1539 WatchSource:0}: Error finding container 2da64431be08b596bd3ae565ab3ae0c10875e81da673ca7a62a18fe200fd1539: Status 404 returned error can't find the container with id 2da64431be08b596bd3ae565ab3ae0c10875e81da673ca7a62a18fe200fd1539 Jul 09 20:46:30.773793 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.773758 2583 generic.go:356] "Generic (PLEG): container finished" podID="f57c2a1f-19e4-4fcf-ae69-948550656b33" containerID="9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332" exitCode=137 Jul 09 20:46:30.773994 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.773809 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" Jul 09 20:46:30.773994 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.773858 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" event={"ID":"f57c2a1f-19e4-4fcf-ae69-948550656b33","Type":"ContainerDied","Data":"9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332"} Jul 09 20:46:30.773994 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.773918 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws" event={"ID":"f57c2a1f-19e4-4fcf-ae69-948550656b33","Type":"ContainerDied","Data":"4a5c98d94e08633b6d614e8f41400df3f0da59ce5edd0323691109a2a32468b1"} Jul 09 20:46:30.773994 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.773945 2583 scope.go:117] "RemoveContainer" containerID="9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332" Jul 09 20:46:30.775323 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.775287 2583 generic.go:356] "Generic (PLEG): container finished" podID="ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb" containerID="efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931" exitCode=137 Jul 09 20:46:30.775471 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.775330 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" Jul 09 20:46:30.775471 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.775341 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" event={"ID":"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb","Type":"ContainerDied","Data":"efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931"} Jul 09 20:46:30.775471 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.775403 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98" event={"ID":"ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb","Type":"ContainerDied","Data":"5a956c61ded045aa6c313963357efd98f873bb1b4792ddad266b95591ac83ed7"} Jul 09 20:46:30.777012 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.776981 2583 generic.go:356] "Generic (PLEG): container finished" podID="d5d688dc-4ff6-41c2-af31-3fa36905efe9" containerID="93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148" exitCode=137 Jul 09 20:46:30.777012 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.777007 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" event={"ID":"d5d688dc-4ff6-41c2-af31-3fa36905efe9","Type":"ContainerDied","Data":"93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148"} Jul 09 20:46:30.777187 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.777045 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" Jul 09 20:46:30.777187 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.777061 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn" event={"ID":"d5d688dc-4ff6-41c2-af31-3fa36905efe9","Type":"ContainerDied","Data":"5572d751810a333da6eafbbfa8d50fe42772cc831ed8901be33514f1b3713f7c"} Jul 09 20:46:30.778859 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.778834 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396085832752" Jul 09 20:46:30.780039 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.780016 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396085830448" event={"ID":"3370588c-7af2-4e3c-81b8-6af1ee074a2b","Type":"ContainerStarted","Data":"2da64431be08b596bd3ae565ab3ae0c10875e81da673ca7a62a18fe200fd1539"} Jul 09 20:46:30.788683 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.788661 2583 scope.go:117] "RemoveContainer" containerID="9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332" Jul 09 20:46:30.788956 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:46:30.788913 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332\": container with ID starting with 9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332 not found: ID does not exist" containerID="9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332" Jul 09 20:46:30.789056 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.788948 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332"} err="failed to get container status \"9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332\": rpc error: code = NotFound desc = could not find container \"9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332\": container with ID starting with 9d07f3cdd6098d46a96ffead99afe9bc8fa2b281fe14e8997484d175ad689332 not found: ID does not exist" Jul 09 20:46:30.789056 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.788972 2583 scope.go:117] "RemoveContainer" containerID="efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931" Jul 09 20:46:30.798881 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.798823 2583 scope.go:117] "RemoveContainer" containerID="efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931" Jul 09 20:46:30.799072 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:46:30.799050 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931\": container with ID starting with efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931 not found: ID does not exist" containerID="efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931" Jul 09 20:46:30.799195 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.799077 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931"} err="failed to get container status \"efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931\": rpc error: code = NotFound desc = could not find container \"efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931\": container with ID starting with efe8335436e154bb06b46e44e0cd3c527ce007ca54d401e0c04fad71fbc3b931 not found: ID does not exist" Jul 09 20:46:30.799195 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.799095 2583 scope.go:117] "RemoveContainer" containerID="93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148" Jul 09 20:46:30.800940 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.800903 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws"] Jul 09 20:46:30.803998 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.803973 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a56db7-29727165-9psws"] Jul 09 20:46:30.808114 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.808098 2583 scope.go:117] "RemoveContainer" containerID="93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148" Jul 09 20:46:30.808383 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:46:30.808363 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148\": container with ID starting with 93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148 not found: ID does not exist" containerID="93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148" Jul 09 20:46:30.808459 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.808392 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148"} err="failed to get container status \"93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148\": rpc error: code = NotFound desc = could not find container \"93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148\": container with ID starting with 93cd04d1a5392eef9c4b59bd4ebbd3ef70efccb28c2f77f7a1839d150ca8e148 not found: ID does not exist" Jul 09 20:46:30.808459 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.808410 2583 scope.go:117] "RemoveContainer" containerID="ab6d56459d29e6db8201355f92998cf7f3a4b9f4161080289c661b6413b3b70e" Jul 09 20:46:30.814338 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.814315 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn"] Jul 09 20:46:30.818997 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.818978 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-8c2e89-29727165-ww2xn"] Jul 09 20:46:30.828206 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.828177 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98"] Jul 09 20:46:30.830494 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:30.830471 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727165-2jz98"] Jul 09 20:46:31.790095 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:31.790063 2583 generic.go:356] "Generic (PLEG): container finished" podID="3370588c-7af2-4e3c-81b8-6af1ee074a2b" containerID="99309e1a9ea4d6b387888f610d65cb07e455b6704428b187b3441747a9a3818c" exitCode=0 Jul 09 20:46:31.790552 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:31.790149 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396085830448" event={"ID":"3370588c-7af2-4e3c-81b8-6af1ee074a2b","Type":"ContainerDied","Data":"99309e1a9ea4d6b387888f610d65cb07e455b6704428b187b3441747a9a3818c"} Jul 09 20:46:32.097381 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:32.097293 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5d688dc-4ff6-41c2-af31-3fa36905efe9" path="/var/lib/kubelet/pods/d5d688dc-4ff6-41c2-af31-3fa36905efe9/volumes" Jul 09 20:46:32.097656 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:32.097642 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb" path="/var/lib/kubelet/pods/ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb/volumes" Jul 09 20:46:32.097927 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:32.097916 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f57c2a1f-19e4-4fcf-ae69-948550656b33" path="/var/lib/kubelet/pods/f57c2a1f-19e4-4fcf-ae69-948550656b33/volumes" Jul 09 20:46:32.944954 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:32.944925 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396085830448" Jul 09 20:46:32.968487 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:32.965165 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7310-140396085830448_3370588c-7af2-4e3c-81b8-6af1ee074a2b/test-curl-7310-140396085830448/0.log" Jul 09 20:46:32.986310 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:32.986283 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7310-140396085830448"] Jul 09 20:46:32.991142 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:32.991117 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7310-140396085830448"] Jul 09 20:46:33.038333 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.038299 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqmrz\" (UniqueName: \"kubernetes.io/projected/3370588c-7af2-4e3c-81b8-6af1ee074a2b-kube-api-access-mqmrz\") pod \"3370588c-7af2-4e3c-81b8-6af1ee074a2b\" (UID: \"3370588c-7af2-4e3c-81b8-6af1ee074a2b\") " Jul 09 20:46:33.040620 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.040595 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3370588c-7af2-4e3c-81b8-6af1ee074a2b-kube-api-access-mqmrz" (OuterVolumeSpecName: "kube-api-access-mqmrz") pod "3370588c-7af2-4e3c-81b8-6af1ee074a2b" (UID: "3370588c-7af2-4e3c-81b8-6af1ee074a2b"). InnerVolumeSpecName "kube-api-access-mqmrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:46:33.139464 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.139419 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqmrz\" (UniqueName: \"kubernetes.io/projected/3370588c-7af2-4e3c-81b8-6af1ee074a2b-kube-api-access-mqmrz\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:46:33.148929 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.148889 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:33.149302 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149287 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb" containerName="cleanup" Jul 09 20:46:33.149302 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149301 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb" containerName="cleanup" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149310 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d688dc-4ff6-41c2-af31-3fa36905efe9" containerName="cleanup" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149315 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d688dc-4ff6-41c2-af31-3fa36905efe9" containerName="cleanup" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149323 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57c2a1f-19e4-4fcf-ae69-948550656b33" containerName="cleanup" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149329 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57c2a1f-19e4-4fcf-ae69-948550656b33" containerName="cleanup" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149336 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3370588c-7af2-4e3c-81b8-6af1ee074a2b" containerName="test-curl-7310-140396085830448" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149342 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3370588c-7af2-4e3c-81b8-6af1ee074a2b" containerName="test-curl-7310-140396085830448" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149408 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3370588c-7af2-4e3c-81b8-6af1ee074a2b" containerName="test-curl-7310-140396085830448" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149417 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5d688dc-4ff6-41c2-af31-3fa36905efe9" containerName="cleanup" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149425 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f57c2a1f-19e4-4fcf-ae69-948550656b33" containerName="cleanup" Jul 09 20:46:33.149429 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.149431 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1a6bbb-e837-4d20-947b-ceaeebe1f1eb" containerName="cleanup" Jul 09 20:46:33.152621 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.152600 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:33.156692 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.156665 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:33.240854 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.240820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glsbn\" (UniqueName: \"kubernetes.io/projected/413c9507-f6c2-4350-9a82-b4ce83d8090f-kube-api-access-glsbn\") pod \"test-curl-7310-140396087789440\" (UID: \"413c9507-f6c2-4350-9a82-b4ce83d8090f\") " pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:33.342003 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.341962 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glsbn\" (UniqueName: \"kubernetes.io/projected/413c9507-f6c2-4350-9a82-b4ce83d8090f-kube-api-access-glsbn\") pod \"test-curl-7310-140396087789440\" (UID: \"413c9507-f6c2-4350-9a82-b4ce83d8090f\") " pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:33.349977 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.349943 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glsbn\" (UniqueName: \"kubernetes.io/projected/413c9507-f6c2-4350-9a82-b4ce83d8090f-kube-api-access-glsbn\") pod \"test-curl-7310-140396087789440\" (UID: \"413c9507-f6c2-4350-9a82-b4ce83d8090f\") " pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:33.463984 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.463893 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:33.609375 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.609349 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:33.611366 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:46:33.611337 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod413c9507_f6c2_4350_9a82_b4ce83d8090f.slice/crio-d5eaad0d5722535c179fb86e7b509fedea6144cb35404fb162bee7209342a20f WatchSource:0}: Error finding container d5eaad0d5722535c179fb86e7b509fedea6144cb35404fb162bee7209342a20f: Status 404 returned error can't find the container with id d5eaad0d5722535c179fb86e7b509fedea6144cb35404fb162bee7209342a20f Jul 09 20:46:33.806735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.806645 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2da64431be08b596bd3ae565ab3ae0c10875e81da673ca7a62a18fe200fd1539" Jul 09 20:46:33.806735 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.806647 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396085830448" Jul 09 20:46:33.807864 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:33.807834 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087789440" event={"ID":"413c9507-f6c2-4350-9a82-b4ce83d8090f","Type":"ContainerStarted","Data":"d5eaad0d5722535c179fb86e7b509fedea6144cb35404fb162bee7209342a20f"} Jul 09 20:46:33.817310 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:46:33.817281 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7310-140396085830448\" is forbidden: User \"system:node:ip-10-0-142-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-249.ec2.internal' and this object" podUID="3370588c-7af2-4e3c-81b8-6af1ee074a2b" pod="openshift-ingress/test-curl-7310-140396085830448" Jul 09 20:46:34.097771 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:34.097693 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3370588c-7af2-4e3c-81b8-6af1ee074a2b" path="/var/lib/kubelet/pods/3370588c-7af2-4e3c-81b8-6af1ee074a2b/volumes" Jul 09 20:46:34.816568 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:34.816533 2583 generic.go:356] "Generic (PLEG): container finished" podID="413c9507-f6c2-4350-9a82-b4ce83d8090f" containerID="31630eaf84f3671a933f98f22ad321ff959f5875e9215b933ce256410e68d56a" exitCode=0 Jul 09 20:46:34.816756 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:34.816611 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087789440" event={"ID":"413c9507-f6c2-4350-9a82-b4ce83d8090f","Type":"ContainerDied","Data":"31630eaf84f3671a933f98f22ad321ff959f5875e9215b933ce256410e68d56a"} Jul 09 20:46:35.978207 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:35.978178 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:35.996634 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:35.996600 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7310-140396087789440_413c9507-f6c2-4350-9a82-b4ce83d8090f/test-curl-7310-140396087789440/0.log" Jul 09 20:46:36.017870 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.017830 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:36.021249 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.021206 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:36.069228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.069196 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glsbn\" (UniqueName: \"kubernetes.io/projected/413c9507-f6c2-4350-9a82-b4ce83d8090f-kube-api-access-glsbn\") pod \"413c9507-f6c2-4350-9a82-b4ce83d8090f\" (UID: \"413c9507-f6c2-4350-9a82-b4ce83d8090f\") " Jul 09 20:46:36.071550 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.071517 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413c9507-f6c2-4350-9a82-b4ce83d8090f-kube-api-access-glsbn" (OuterVolumeSpecName: "kube-api-access-glsbn") pod "413c9507-f6c2-4350-9a82-b4ce83d8090f" (UID: "413c9507-f6c2-4350-9a82-b4ce83d8090f"). InnerVolumeSpecName "kube-api-access-glsbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:46:36.096153 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.096106 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413c9507-f6c2-4350-9a82-b4ce83d8090f" path="/var/lib/kubelet/pods/413c9507-f6c2-4350-9a82-b4ce83d8090f/volumes" Jul 09 20:46:36.145241 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.145204 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:36.145652 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.145638 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413c9507-f6c2-4350-9a82-b4ce83d8090f" containerName="test-curl-7310-140396087789440" Jul 09 20:46:36.145703 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.145654 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="413c9507-f6c2-4350-9a82-b4ce83d8090f" containerName="test-curl-7310-140396087789440" Jul 09 20:46:36.145739 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.145733 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="413c9507-f6c2-4350-9a82-b4ce83d8090f" containerName="test-curl-7310-140396087789440" Jul 09 20:46:36.148863 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.148846 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:36.155968 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.155939 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:36.171746 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.171694 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glsbn\" (UniqueName: \"kubernetes.io/projected/413c9507-f6c2-4350-9a82-b4ce83d8090f-kube-api-access-glsbn\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:46:36.272824 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.272779 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6r2c\" (UniqueName: \"kubernetes.io/projected/6b950f97-98f7-4840-bb19-b76749c10b9d-kube-api-access-d6r2c\") pod \"test-curl-7310-140396087789440\" (UID: \"6b950f97-98f7-4840-bb19-b76749c10b9d\") " pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:36.374222 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.374124 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6r2c\" (UniqueName: \"kubernetes.io/projected/6b950f97-98f7-4840-bb19-b76749c10b9d-kube-api-access-d6r2c\") pod \"test-curl-7310-140396087789440\" (UID: \"6b950f97-98f7-4840-bb19-b76749c10b9d\") " pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:36.382770 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.382733 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6r2c\" (UniqueName: \"kubernetes.io/projected/6b950f97-98f7-4840-bb19-b76749c10b9d-kube-api-access-d6r2c\") pod \"test-curl-7310-140396087789440\" (UID: \"6b950f97-98f7-4840-bb19-b76749c10b9d\") " pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:36.460602 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.460560 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:36.611268 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.611232 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:36.612879 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:46:36.612846 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b950f97_98f7_4840_bb19_b76749c10b9d.slice/crio-388f7e9dadf8c99411a1d05b33383448e82e9ade00e456ec7c8d6aa14db9ef2d WatchSource:0}: Error finding container 388f7e9dadf8c99411a1d05b33383448e82e9ade00e456ec7c8d6aa14db9ef2d: Status 404 returned error can't find the container with id 388f7e9dadf8c99411a1d05b33383448e82e9ade00e456ec7c8d6aa14db9ef2d Jul 09 20:46:36.830792 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.830765 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:36.830792 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.830784 2583 scope.go:117] "RemoveContainer" containerID="31630eaf84f3671a933f98f22ad321ff959f5875e9215b933ce256410e68d56a" Jul 09 20:46:36.832338 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:36.832291 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087789440" event={"ID":"6b950f97-98f7-4840-bb19-b76749c10b9d","Type":"ContainerStarted","Data":"388f7e9dadf8c99411a1d05b33383448e82e9ade00e456ec7c8d6aa14db9ef2d"} Jul 09 20:46:37.839814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:37.839778 2583 generic.go:356] "Generic (PLEG): container finished" podID="6b950f97-98f7-4840-bb19-b76749c10b9d" containerID="f0b58a81a8a0cf439806978642bb338ebfbcc16260b4983f502ba8c17babfe7f" exitCode=0 Jul 09 20:46:37.840230 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:37.839870 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087789440" event={"ID":"6b950f97-98f7-4840-bb19-b76749c10b9d","Type":"ContainerDied","Data":"f0b58a81a8a0cf439806978642bb338ebfbcc16260b4983f502ba8c17babfe7f"} Jul 09 20:46:38.987440 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:38.987416 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:39.007981 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.007953 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7310-140396087789440_6b950f97-98f7-4840-bb19-b76749c10b9d/test-curl-7310-140396087789440/0.log" Jul 09 20:46:39.032130 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.032100 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:39.035136 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.035111 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7310-140396087789440"] Jul 09 20:46:39.100572 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.100494 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6r2c\" (UniqueName: \"kubernetes.io/projected/6b950f97-98f7-4840-bb19-b76749c10b9d-kube-api-access-d6r2c\") pod \"6b950f97-98f7-4840-bb19-b76749c10b9d\" (UID: \"6b950f97-98f7-4840-bb19-b76749c10b9d\") " Jul 09 20:46:39.102662 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.102629 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b950f97-98f7-4840-bb19-b76749c10b9d-kube-api-access-d6r2c" (OuterVolumeSpecName: "kube-api-access-d6r2c") pod "6b950f97-98f7-4840-bb19-b76749c10b9d" (UID: "6b950f97-98f7-4840-bb19-b76749c10b9d"). InnerVolumeSpecName "kube-api-access-d6r2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:46:39.161122 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.161082 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"] Jul 09 20:46:39.161636 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.161621 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b950f97-98f7-4840-bb19-b76749c10b9d" containerName="test-curl-7310-140396087789440" Jul 09 20:46:39.161750 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.161638 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b950f97-98f7-4840-bb19-b76749c10b9d" containerName="test-curl-7310-140396087789440" Jul 09 20:46:39.161750 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.161716 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b950f97-98f7-4840-bb19-b76749c10b9d" containerName="test-curl-7310-140396087789440" Jul 09 20:46:39.164772 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.164749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087790448" Jul 09 20:46:39.168916 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.168893 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"] Jul 09 20:46:39.201509 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.201478 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6r2c\" (UniqueName: \"kubernetes.io/projected/6b950f97-98f7-4840-bb19-b76749c10b9d-kube-api-access-d6r2c\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:46:39.302353 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.302310 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55fb5\" (UniqueName: \"kubernetes.io/projected/335330b8-3f95-4b35-90e2-3073af90d915-kube-api-access-55fb5\") pod \"test-curl-7310-140396087790448\" (UID: \"335330b8-3f95-4b35-90e2-3073af90d915\") " pod="openshift-ingress/test-curl-7310-140396087790448" Jul 09 20:46:39.402862 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.402820 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55fb5\" (UniqueName: \"kubernetes.io/projected/335330b8-3f95-4b35-90e2-3073af90d915-kube-api-access-55fb5\") pod \"test-curl-7310-140396087790448\" (UID: \"335330b8-3f95-4b35-90e2-3073af90d915\") " pod="openshift-ingress/test-curl-7310-140396087790448" Jul 09 20:46:39.410949 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.410923 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55fb5\" (UniqueName: \"kubernetes.io/projected/335330b8-3f95-4b35-90e2-3073af90d915-kube-api-access-55fb5\") pod \"test-curl-7310-140396087790448\" (UID: \"335330b8-3f95-4b35-90e2-3073af90d915\") " pod="openshift-ingress/test-curl-7310-140396087790448" Jul 09 20:46:39.474543 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.474511 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087790448" Jul 09 20:46:39.610137 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.610112 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"] Jul 09 20:46:39.612034 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:46:39.612010 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod335330b8_3f95_4b35_90e2_3073af90d915.slice/crio-1b65b8916f0872a1c33ef548f799ea2a38f3627e34896ad3fe162b07365f0fc5 WatchSource:0}: Error finding container 1b65b8916f0872a1c33ef548f799ea2a38f3627e34896ad3fe162b07365f0fc5: Status 404 returned error can't find the container with id 1b65b8916f0872a1c33ef548f799ea2a38f3627e34896ad3fe162b07365f0fc5 Jul 09 20:46:39.854400 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.854306 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087790448" event={"ID":"335330b8-3f95-4b35-90e2-3073af90d915","Type":"ContainerStarted","Data":"1b65b8916f0872a1c33ef548f799ea2a38f3627e34896ad3fe162b07365f0fc5"} Jul 09 20:46:39.855820 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.855787 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="388f7e9dadf8c99411a1d05b33383448e82e9ade00e456ec7c8d6aa14db9ef2d" Jul 09 20:46:39.855820 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:39.855792 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:39.867072 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:46:39.867038 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7310-140396087789440\" is forbidden: User \"system:node:ip-10-0-142-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-249.ec2.internal' and this object" podUID="6b950f97-98f7-4840-bb19-b76749c10b9d" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:40.100648 ip-10-0-142-249 kubenswrapper[2583]: E0709 20:46:40.100605 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7310-140396087789440\" is forbidden: User \"system:node:ip-10-0-142-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-249.ec2.internal' and this object" podUID="6b950f97-98f7-4840-bb19-b76749c10b9d" pod="openshift-ingress/test-curl-7310-140396087789440" Jul 09 20:46:40.104758 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:40.104682 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b950f97-98f7-4840-bb19-b76749c10b9d" path="/var/lib/kubelet/pods/6b950f97-98f7-4840-bb19-b76749c10b9d/volumes" Jul 09 20:46:40.864690 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:40.864651 2583 generic.go:356] "Generic (PLEG): container finished" podID="335330b8-3f95-4b35-90e2-3073af90d915" containerID="9ee6d039a81abafe9ba2668bf93ece809a09ea54ef25ef2efd414373ac3c12e8" exitCode=0 Jul 09 20:46:40.864874 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:40.864694 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087790448" event={"ID":"335330b8-3f95-4b35-90e2-3073af90d915","Type":"ContainerDied","Data":"9ee6d039a81abafe9ba2668bf93ece809a09ea54ef25ef2efd414373ac3c12e8"} Jul 09 20:46:42.016469 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.016428 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087790448" Jul 09 20:46:42.036571 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.036536 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7310-140396087790448_335330b8-3f95-4b35-90e2-3073af90d915/test-curl-7310-140396087790448/0.log" Jul 09 20:46:42.061692 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.061650 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"] Jul 09 20:46:42.067116 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.067084 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"] Jul 09 20:46:42.127042 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.126948 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55fb5\" (UniqueName: \"kubernetes.io/projected/335330b8-3f95-4b35-90e2-3073af90d915-kube-api-access-55fb5\") pod \"335330b8-3f95-4b35-90e2-3073af90d915\" (UID: \"335330b8-3f95-4b35-90e2-3073af90d915\") " Jul 09 20:46:42.129247 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.129218 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/335330b8-3f95-4b35-90e2-3073af90d915-kube-api-access-55fb5" (OuterVolumeSpecName: "kube-api-access-55fb5") pod "335330b8-3f95-4b35-90e2-3073af90d915" (UID: "335330b8-3f95-4b35-90e2-3073af90d915"). InnerVolumeSpecName "kube-api-access-55fb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 20:46:42.227875 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.227834 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55fb5\" (UniqueName: \"kubernetes.io/projected/335330b8-3f95-4b35-90e2-3073af90d915-kube-api-access-55fb5\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\"" Jul 09 20:46:42.879413 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.879382 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087790448" Jul 09 20:46:42.879627 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:42.879441 2583 scope.go:117] "RemoveContainer" containerID="9ee6d039a81abafe9ba2668bf93ece809a09ea54ef25ef2efd414373ac3c12e8" Jul 09 20:46:44.096980 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:44.096939 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="335330b8-3f95-4b35-90e2-3073af90d915" path="/var/lib/kubelet/pods/335330b8-3f95-4b35-90e2-3073af90d915/volumes" Jul 09 20:46:45.874850 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:45.874815 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:46.322281 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:46.322246 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:46.422232 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:46.422195 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:46.522390 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:46.522352 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:46.622239 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:46.622148 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:51.983815 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:51.983777 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:52.048008 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:52.047974 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:52.239265 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:52.239161 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:52.445414 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:52.445357 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:52.606679 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:52.606594 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:53.004213 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:53.004173 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:53.105329 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:53.105293 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:53.248060 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:53.248017 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:59.124427 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:59.124393 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:59.181354 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:59.181327 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:59.387794 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:59.387742 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:46:59.606228 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:46:59.606190 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:47:04.950933 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:04.950886 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j6rln_927f17b9-7b00-4ce9-b6eb-e06a9dc086d8/manager/0.log" Jul 09 20:47:05.074526 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:05.074495 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9fcx6_e72e577e-30dd-4ab5-8b02-e926b8480107/manager/0.log" Jul 09 20:47:05.341694 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:05.341613 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tvdb5_47292a09-f0e5-47d0-9029-37f247a3558c/server/0.log" Jul 09 20:47:05.827211 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:05.827178 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f986597c-pltdn_07c530b7-da69-4a16-a647-abddfa331470/manager/0.log" Jul 09 20:47:05.833221 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:05.833198 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f986597c-pltdn_07c530b7-da69-4a16-a647-abddfa331470/copy-manifests/0.log" Jul 09 20:47:07.107838 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.107801 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5_33fea8ea-d85d-4ffd-a0ca-a6ab411eb625/util/0.log" Jul 09 20:47:07.114143 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.114115 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5_33fea8ea-d85d-4ffd-a0ca-a6ab411eb625/pull/0.log" Jul 09 20:47:07.120471 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.120422 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5_33fea8ea-d85d-4ffd-a0ca-a6ab411eb625/extract/0.log" Jul 09 20:47:07.236091 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.236060 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv_e4eb2f3e-bc5f-4b2c-b024-38296aeece4c/util/0.log" Jul 09 20:47:07.242710 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.242675 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv_e4eb2f3e-bc5f-4b2c-b024-38296aeece4c/pull/0.log" Jul 09 20:47:07.249169 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.249144 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv_e4eb2f3e-bc5f-4b2c-b024-38296aeece4c/extract/0.log" Jul 09 20:47:07.364953 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.364864 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9_44cb1a0d-bb20-4d08-aca7-97de893cd174/extract/0.log" Jul 09 20:47:07.370871 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.370848 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9_44cb1a0d-bb20-4d08-aca7-97de893cd174/util/0.log" Jul 09 20:47:07.376620 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.376596 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9_44cb1a0d-bb20-4d08-aca7-97de893cd174/pull/0.log" Jul 09 20:47:07.487053 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.487024 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql_89ed56b6-0307-4d4a-b5c1-ae26046bc93d/extract/0.log" Jul 09 20:47:07.492756 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.492733 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql_89ed56b6-0307-4d4a-b5c1-ae26046bc93d/util/0.log" Jul 09 20:47:07.500976 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.500954 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql_89ed56b6-0307-4d4a-b5c1-ae26046bc93d/pull/0.log" Jul 09 20:47:07.742349 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:07.742322 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rf4cz_acad012b-39b5-4356-8d64-f3ac7e25a4db/manager/0.log" Jul 09 20:47:08.244657 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:08.244628 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rfd5c_f3ec417e-4df5-408c-9225-1f20f49b2e64/manager/0.log" Jul 09 20:47:08.856494 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:08.856442 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ghhjp_25062173-0c5c-42df-8707-d4ca3585f117/istio-proxy/0.log" Jul 09 20:47:10.281440 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:10.281407 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4j5mp_7fda8056-3c0d-4348-80d5-6e9d7cbe701f/main/0.log" Jul 09 20:47:10.515608 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:10.515574 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7ptm8_f77b260d-f645-4e23-8533-f64f817e0b66/main/0.log" Jul 09 20:47:14.326485 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:14.326432 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:47:14.429464 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:14.429422 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" limit=1024 Jul 09 20:47:17.112004 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:17.111970 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8hmwh_3f591d68-dbcc-4d9c-9dab-cac01af2da3c/global-pull-secret-syncer/0.log" Jul 09 20:47:17.248866 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:17.248824 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6zcck_9ff28489-1fdf-459c-9276-e419e8dfaeab/konnectivity-agent/0.log" Jul 09 20:47:17.390180 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:17.390140 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-249.ec2.internal_4539760177c018eb2482b2e095c48863/haproxy/0.log" Jul 09 20:47:21.751136 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.751103 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5_33fea8ea-d85d-4ffd-a0ca-a6ab411eb625/extract/0.log" Jul 09 20:47:21.778245 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.778211 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5_33fea8ea-d85d-4ffd-a0ca-a6ab411eb625/util/0.log" Jul 09 20:47:21.807727 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.807697 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595rmt5_33fea8ea-d85d-4ffd-a0ca-a6ab411eb625/pull/0.log" Jul 09 20:47:21.851751 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.851718 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv_e4eb2f3e-bc5f-4b2c-b024-38296aeece4c/extract/0.log" Jul 09 20:47:21.873430 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.873406 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv_e4eb2f3e-bc5f-4b2c-b024-38296aeece4c/util/0.log" Jul 09 20:47:21.895453 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.895429 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09hrfv_e4eb2f3e-bc5f-4b2c-b024-38296aeece4c/pull/0.log" Jul 09 20:47:21.922157 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.922132 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9_44cb1a0d-bb20-4d08-aca7-97de893cd174/extract/0.log" Jul 09 20:47:21.943692 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.943666 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9_44cb1a0d-bb20-4d08-aca7-97de893cd174/util/0.log" Jul 09 20:47:21.964269 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.964244 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732llk9_44cb1a0d-bb20-4d08-aca7-97de893cd174/pull/0.log" Jul 09 20:47:21.990893 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:21.990862 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql_89ed56b6-0307-4d4a-b5c1-ae26046bc93d/extract/0.log" Jul 09 20:47:22.018394 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:22.018307 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql_89ed56b6-0307-4d4a-b5c1-ae26046bc93d/util/0.log" Jul 09 20:47:22.040565 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:22.040539 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1922ql_89ed56b6-0307-4d4a-b5c1-ae26046bc93d/pull/0.log" Jul 09 20:47:22.523978 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:22.523946 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rf4cz_acad012b-39b5-4356-8d64-f3ac7e25a4db/manager/0.log" Jul 09 20:47:22.774295 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:22.774213 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rfd5c_f3ec417e-4df5-408c-9225-1f20f49b2e64/manager/0.log" Jul 09 20:47:24.741274 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:24.741246 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z8cbm_487fa520-9f5e-4f2f-a85f-edd7907fab3f/kube-state-metrics/0.log" Jul 09 20:47:24.778770 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:24.778740 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z8cbm_487fa520-9f5e-4f2f-a85f-edd7907fab3f/kube-rbac-proxy-main/0.log" Jul 09 20:47:24.812717 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:24.812681 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z8cbm_487fa520-9f5e-4f2f-a85f-edd7907fab3f/kube-rbac-proxy-self/0.log" Jul 09 20:47:24.861814 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:24.861730 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69dbc768-ms787_d29f86cb-414e-47f8-8e6f-9120009c2d0e/metrics-server/0.log" Jul 09 20:47:24.894792 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:24.894765 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-n4dvm_7ed69cda-db0d-4799-a5f9-39fb4350f0e9/monitoring-plugin/0.log" Jul 09 20:47:25.154293 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.154265 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mx5sd_af2b69e0-b56f-40e1-986f-0c2acb0392f2/node-exporter/0.log" Jul 09 20:47:25.181209 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.181183 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mx5sd_af2b69e0-b56f-40e1-986f-0c2acb0392f2/kube-rbac-proxy/0.log" Jul 09 20:47:25.209882 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.209847 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mx5sd_af2b69e0-b56f-40e1-986f-0c2acb0392f2/init-textfile/0.log" Jul 09 20:47:25.516426 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.516335 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-v8x7p_4fbc0815-2403-4a3f-8d37-07d7d0b3423b/prometheus-operator/0.log" Jul 09 20:47:25.536748 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.536718 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-v8x7p_4fbc0815-2403-4a3f-8d37-07d7d0b3423b/kube-rbac-proxy/0.log" Jul 09 20:47:25.596731 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.596705 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bfc47d95d-bg6vw_9fe03ae0-49e9-411c-93e3-558e91d6fb7d/telemeter-client/0.log" Jul 09 20:47:25.619594 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.619567 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bfc47d95d-bg6vw_9fe03ae0-49e9-411c-93e3-558e91d6fb7d/reload/0.log" Jul 09 20:47:25.643636 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.643608 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bfc47d95d-bg6vw_9fe03ae0-49e9-411c-93e3-558e91d6fb7d/kube-rbac-proxy/0.log" Jul 09 20:47:25.676980 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.676954 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf6ccfff-nbpd4_bed066a7-4dc2-409d-9f42-b243382abf84/thanos-query/0.log" Jul 09 20:47:25.699145 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.699113 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf6ccfff-nbpd4_bed066a7-4dc2-409d-9f42-b243382abf84/kube-rbac-proxy-web/0.log" Jul 09 20:47:25.722670 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.722644 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf6ccfff-nbpd4_bed066a7-4dc2-409d-9f42-b243382abf84/kube-rbac-proxy/0.log" Jul 09 20:47:25.746802 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.746774 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf6ccfff-nbpd4_bed066a7-4dc2-409d-9f42-b243382abf84/prom-label-proxy/0.log" Jul 09 20:47:25.770158 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.770074 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf6ccfff-nbpd4_bed066a7-4dc2-409d-9f42-b243382abf84/kube-rbac-proxy-rules/0.log" Jul 09 20:47:25.792610 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:25.792579 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cbf6ccfff-nbpd4_bed066a7-4dc2-409d-9f42-b243382abf84/kube-rbac-proxy-metrics/0.log" Jul 09 20:47:27.458911 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.458876 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk"] Jul 09 20:47:27.459326 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.459313 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="335330b8-3f95-4b35-90e2-3073af90d915" containerName="test-curl-7310-140396087790448" Jul 09 20:47:27.459372 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.459327 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="335330b8-3f95-4b35-90e2-3073af90d915" containerName="test-curl-7310-140396087790448" Jul 09 20:47:27.459406 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.459399 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="335330b8-3f95-4b35-90e2-3073af90d915" containerName="test-curl-7310-140396087790448" Jul 09 20:47:27.462788 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.462768 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.465136 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.465101 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-76kn5\"/\"kube-root-ca.crt\"" Jul 09 20:47:27.465136 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.465135 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-76kn5\"/\"default-dockercfg-cblvf\"" Jul 09 20:47:27.466223 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.466204 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-76kn5\"/\"openshift-service-ca.crt\"" Jul 09 20:47:27.472169 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.472137 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk"] Jul 09 20:47:27.542642 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.542611 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-sys\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.542830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.542660 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-proc\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.542830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.542704 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-podres\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.542830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.542778 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-lib-modules\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.542830 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.542803 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfkj9\" (UniqueName: \"kubernetes.io/projected/3bccbdac-0008-49b6-a114-561598fe2520-kube-api-access-bfkj9\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.643931 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.643887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-proc\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.643931 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.643926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-podres\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.644144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.643954 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-lib-modules\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.644144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.643986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfkj9\" (UniqueName: \"kubernetes.io/projected/3bccbdac-0008-49b6-a114-561598fe2520-kube-api-access-bfkj9\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.644144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.644021 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-proc\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.644144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.644075 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-podres\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.644144 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.644104 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-sys\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.644313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.644141 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-lib-modules\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.644313 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.644208 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bccbdac-0008-49b6-a114-561598fe2520-sys\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.652133 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.652099 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfkj9\" (UniqueName: \"kubernetes.io/projected/3bccbdac-0008-49b6-a114-561598fe2520-kube-api-access-bfkj9\") pod \"perf-node-gather-daemonset-f5jbk\" (UID: \"3bccbdac-0008-49b6-a114-561598fe2520\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.774561 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.774442 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:27.914827 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:27.914799 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk"] Jul 09 20:47:27.916602 ip-10-0-142-249 kubenswrapper[2583]: W0709 20:47:27.916563 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3bccbdac_0008_49b6_a114_561598fe2520.slice/crio-450a4ed6c7395bc1373819ad9335427859c93556b650f4e767d44a5fe0db7271 WatchSource:0}: Error finding container 450a4ed6c7395bc1373819ad9335427859c93556b650f4e767d44a5fe0db7271: Status 404 returned error can't find the container with id 450a4ed6c7395bc1373819ad9335427859c93556b650f4e767d44a5fe0db7271 Jul 09 20:47:28.138686 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:28.138654 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" event={"ID":"3bccbdac-0008-49b6-a114-561598fe2520","Type":"ContainerStarted","Data":"55b6150834589d2caee218f5908713c8a5eb0ce1f32a2419ff00a37d7a0e3000"} Jul 09 20:47:28.138863 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:28.138704 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" event={"ID":"3bccbdac-0008-49b6-a114-561598fe2520","Type":"ContainerStarted","Data":"450a4ed6c7395bc1373819ad9335427859c93556b650f4e767d44a5fe0db7271"} Jul 09 20:47:28.138863 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:28.138742 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:28.154659 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:28.154610 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" podStartSLOduration=1.15459462 podStartE2EDuration="1.15459462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:47:28.152925781 +0000 UTC m=+2668.610063022" watchObservedRunningTime="2026-07-09 20:47:28.15459462 +0000 UTC m=+2668.611731861" Jul 09 20:47:28.182146 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:28.182120 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59f8dc7985-7fcrl_ec8fac30-8639-4449-8707-a3be6e892491/console/0.log" Jul 09 20:47:28.216876 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:28.216835 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-ng8mp_2ae5c1f2-4e28-4fc2-a68b-3a0c6585ab31/download-server/0.log" Jul 09 20:47:29.920244 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:29.920209 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lrrr2_bf2c14ea-7c7e-401b-b1ef-c0d536b80326/dns/0.log" Jul 09 20:47:29.946996 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:29.946966 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lrrr2_bf2c14ea-7c7e-401b-b1ef-c0d536b80326/kube-rbac-proxy/0.log" Jul 09 20:47:30.075341 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:30.075304 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mhh5_af01d5f8-ca96-44ab-bc22-20cd38611e55/dns-node-resolver/0.log" Jul 09 20:47:30.741263 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:30.741234 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qtcr8_1d5ffb5f-ec68-44fe-9ff2-d48accd74fd7/node-ca/0.log" Jul 09 20:47:31.679264 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:31.679237 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ghhjp_25062173-0c5c-42df-8707-d4ca3585f117/istio-proxy/0.log" Jul 09 20:47:32.732594 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:32.732525 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kpr8l_9dd12031-29c3-4589-b254-a5464bda09a9/serve-healthcheck-canary/0.log" Jul 09 20:47:33.480265 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:33.480241 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjk8d_e4457d7a-2334-470b-87c8-f2b7d3a8d72c/kube-rbac-proxy/0.log" Jul 09 20:47:33.507959 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:33.507933 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjk8d_e4457d7a-2334-470b-87c8-f2b7d3a8d72c/exporter/0.log" Jul 09 20:47:33.534689 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:33.534664 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjk8d_e4457d7a-2334-470b-87c8-f2b7d3a8d72c/extractor/0.log" Jul 09 20:47:34.154981 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:34.154953 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-f5jbk" Jul 09 20:47:35.687293 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:35.687265 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j6rln_927f17b9-7b00-4ce9-b6eb-e06a9dc086d8/manager/0.log" Jul 09 20:47:35.828947 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:35.828909 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9fcx6_e72e577e-30dd-4ab5-8b02-e926b8480107/manager/0.log" Jul 09 20:47:35.940013 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:35.939929 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tvdb5_47292a09-f0e5-47d0-9029-37f247a3558c/server/0.log" Jul 09 20:47:36.213657 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:36.213575 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f986597c-pltdn_07c530b7-da69-4a16-a647-abddfa331470/manager/0.log" Jul 09 20:47:36.236038 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:36.236014 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f986597c-pltdn_07c530b7-da69-4a16-a647-abddfa331470/copy-manifests/0.log" Jul 09 20:47:37.669981 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:37.669955 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5fd67cd5cb-k9wlj_0094c174-8006-40e2-9045-d37ac315323d/manager/0.log" Jul 09 20:47:38.460338 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:38.460301 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ghhjp_25062173-0c5c-42df-8707-d4ca3585f117/istio-proxy/0.log" Jul 09 20:47:39.944862 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:39.944836 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ghhjp_25062173-0c5c-42df-8707-d4ca3585f117/istio-proxy/0.log" Jul 09 20:47:44.340559 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.340522 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6k9c4_0b1aafb2-3655-4327-aa7e-6d5aae3a10e8/kube-multus/0.log" Jul 09 20:47:44.688465 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.688429 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkcx6_c508b8a3-2f43-4f0c-841f-e766037c4858/kube-multus-additional-cni-plugins/0.log" Jul 09 20:47:44.710362 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.710335 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkcx6_c508b8a3-2f43-4f0c-841f-e766037c4858/egress-router-binary-copy/0.log" Jul 09 20:47:44.731941 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.731915 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkcx6_c508b8a3-2f43-4f0c-841f-e766037c4858/cni-plugins/0.log" Jul 09 20:47:44.754165 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.754136 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkcx6_c508b8a3-2f43-4f0c-841f-e766037c4858/bond-cni-plugin/0.log" Jul 09 20:47:44.776879 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.776846 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkcx6_c508b8a3-2f43-4f0c-841f-e766037c4858/routeoverride-cni/0.log" Jul 09 20:47:44.799936 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.799907 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkcx6_c508b8a3-2f43-4f0c-841f-e766037c4858/whereabouts-cni-bincopy/0.log" Jul 09 20:47:44.821724 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.821698 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkcx6_c508b8a3-2f43-4f0c-841f-e766037c4858/whereabouts-cni/0.log" Jul 09 20:47:44.961688 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.961599 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k9bkk_1367c363-01b3-4c1e-bc94-5e8bd1afef16/network-metrics-daemon/0.log" Jul 09 20:47:44.982434 ip-10-0-142-249 kubenswrapper[2583]: I0709 20:47:44.982405 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k9bkk_1367c363-01b3-4c1e-bc94-5e8bd1afef16/kube-rbac-proxy/0.log"