Jul 16 17:17:53.947200 ip-10-0-131-79 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 17:17:53.947211 ip-10-0-131-79 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 17:17:53.947218 ip-10-0-131-79 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 17:17:53.947441 ip-10-0-131-79 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 17:18:02.982207 ip-10-0-131-79 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 17:18:02.982222 ip-10-0-131-79 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 51a2c1a4dba24ac6be3791e9f6f8e7d1 -- Jul 16 17:19:36.526224 ip-10-0-131-79 systemd[1]: Starting Kubernetes Kubelet... Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.008520 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017787 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017806 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017832 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017838 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017841 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017845 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017848 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:19:37.075473 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017851 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017854 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017857 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017860 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017863 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017866 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017869 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017871 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017874 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017876 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017879 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017881 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017884 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017886 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017889 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017891 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017893 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017902 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017905 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017908 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:19:37.077686 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017910 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017917 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017921 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017925 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017927 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017930 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017932 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017935 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017938 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017941 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017943 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017947 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017952 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017955 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017957 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017960 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017962 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017966 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017970 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017973 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:19:37.080217 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017976 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017979 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017982 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017986 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017989 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017991 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017994 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.017998 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018000 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018003 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018006 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018010 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018012 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018015 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018018 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018020 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018023 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018025 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018029 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:19:37.082080 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018031 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018035 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018039 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018043 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018046 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018050 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018053 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018056 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018058 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018062 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018065 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018067 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018070 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018073 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018077 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018079 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018082 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018085 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018088 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:19:37.084242 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018091 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018093 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018096 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018098 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018101 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018103 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018107 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018109 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018112 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018114 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018117 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018120 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018122 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018125 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018879 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018887 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018890 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018894 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018897 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018900 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:19:37.099324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018903 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:19:37.091193 ip-10-0-131-79 systemd[1]: Started Kubernetes Kubelet. Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018906 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018908 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018911 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018913 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018916 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018919 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018922 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018925 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018928 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018930 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018933 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018936 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018938 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018942 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018945 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018947 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018950 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018952 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018955 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:19:37.102020 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018957 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018960 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018963 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018965 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018967 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018970 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018972 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018978 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018981 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018984 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018986 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018989 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018991 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018994 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018996 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.018999 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019002 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019005 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019007 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019010 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:19:37.116512 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019012 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019015 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019018 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019020 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019024 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019027 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019029 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019032 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019035 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019037 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019040 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019042 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019044 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019047 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019050 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019053 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019055 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019058 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019062 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:19:37.131747 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019068 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019071 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019074 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019077 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019080 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019083 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019086 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019089 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019092 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019095 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019097 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019100 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019103 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019106 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019108 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019112 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019116 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019119 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019122 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019125 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:19:37.147354 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019127 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019130 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019134 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019137 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019139 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019141 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019144 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019146 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019149 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019152 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019155 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019157 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019163 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019167 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019563 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019568 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019572 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019575 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019580 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:19:37.179494 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019583 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019586 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019589 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019592 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019595 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019598 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019601 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019603 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019606 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019609 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019611 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019614 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019617 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019620 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019623 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019625 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019628 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019632 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019635 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019638 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:19:37.316331 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019641 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019643 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019646 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019649 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019653 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019657 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019660 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019662 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019665 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019667 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019670 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019672 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019675 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019677 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019680 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019682 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019685 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019687 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019690 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019693 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:19:37.317656 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019695 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019697 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019701 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019703 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019706 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019709 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019711 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019714 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019716 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019721 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019725 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019728 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019731 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019734 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019737 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019740 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019743 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019747 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019750 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:19:37.318508 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019752 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019755 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019757 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019760 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019763 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019765 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019769 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019772 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019774 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019777 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019779 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019782 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019785 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019787 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019789 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019792 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019794 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019797 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019800 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:19:37.319325 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019803 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019805 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019808 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019829 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019834 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019836 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019839 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019841 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019844 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019846 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019849 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019853 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019856 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019859 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019861 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.019864 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019940 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019948 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019955 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019960 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019967 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 17:19:37.320165 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019971 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019975 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019980 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019984 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019987 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019990 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019994 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.019997 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020000 2579 flags.go:64] FLAG: --cgroup-root="" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020003 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020006 2579 flags.go:64] FLAG: --client-ca-file="" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020010 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020013 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020017 2579 flags.go:64] FLAG: --cluster-domain="" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020022 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020025 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020029 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020032 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020036 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020039 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020042 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020045 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020049 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020053 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 17:19:37.321185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020056 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020059 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020062 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020066 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020069 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020073 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020075 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020078 2579 flags.go:64] FLAG: --enable-server="true" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020081 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020086 2579 flags.go:64] FLAG: --event-burst="100" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020089 2579 flags.go:64] FLAG: --event-qps="50" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020092 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020095 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020098 2579 flags.go:64] FLAG: --eviction-hard="" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020102 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020105 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020108 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020111 2579 flags.go:64] FLAG: --eviction-soft="" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020114 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020116 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020127 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020130 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020135 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020137 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020140 2579 flags.go:64] FLAG: --feature-gates="" Jul 16 17:19:37.322219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020149 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020152 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020155 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020158 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020161 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020165 2579 flags.go:64] FLAG: --help="false" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020169 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020171 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020174 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020177 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020180 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020184 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020187 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020190 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020192 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020195 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020198 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020201 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020204 2579 flags.go:64] FLAG: --kube-reserved="" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020207 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020210 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020213 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020216 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020219 2579 flags.go:64] FLAG: --lock-file="" Jul 16 17:19:37.322996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020221 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020224 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020227 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020233 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020236 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020240 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020243 2579 flags.go:64] FLAG: --logging-format="text" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020246 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020249 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020252 2579 flags.go:64] FLAG: --manifest-url="" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020255 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020259 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020262 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020268 2579 flags.go:64] FLAG: --max-pods="110" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020271 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020274 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020277 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020280 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020283 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020286 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020289 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020296 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020299 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020302 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 17:19:37.325395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020306 2579 flags.go:64] FLAG: --pod-cidr="" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020309 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020315 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020318 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020321 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020323 2579 flags.go:64] FLAG: --port="10250" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020326 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020329 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bce266dede841ce1" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020332 2579 flags.go:64] FLAG: --qos-reserved="" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020335 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020338 2579 flags.go:64] FLAG: --register-node="true" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020341 2579 flags.go:64] FLAG: --register-with-taints="" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020345 2579 flags.go:64] FLAG: --registry-burst="10" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020349 2579 flags.go:64] FLAG: --registry-qps="5" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020352 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020355 2579 flags.go:64] FLAG: --reserved-memory="" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020359 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020362 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020365 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020368 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020370 2579 flags.go:64] FLAG: --runonce="false" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020373 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020378 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020381 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020384 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 17:19:37.326190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020387 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020390 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020393 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020396 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020399 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020402 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020405 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020408 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020411 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020414 2579 flags.go:64] FLAG: --system-cgroups="" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020416 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020422 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020429 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020432 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020436 2579 flags.go:64] FLAG: --tls-min-version="" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020439 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020442 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020445 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020448 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020451 2579 flags.go:64] FLAG: --v="2" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020456 2579 flags.go:64] FLAG: --version="false" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020461 2579 flags.go:64] FLAG: --vmodule="" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020465 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.020468 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 17:19:37.327841 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020579 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020583 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020586 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020589 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020592 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020596 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020600 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020603 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020606 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020609 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020611 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020614 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020617 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020620 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020623 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020626 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020628 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020631 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020633 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020636 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:19:37.328542 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020639 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020641 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020644 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020646 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020649 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020652 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020654 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020657 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020661 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020664 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020668 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020671 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020674 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020677 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020681 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020684 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020687 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020691 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020694 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:19:37.409531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020697 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020700 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020703 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020705 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020708 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020711 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020714 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020716 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020719 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020722 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020724 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020727 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020729 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020732 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020734 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020737 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020739 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020742 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020744 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020747 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:19:37.410430 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020749 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020753 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020755 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020758 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020762 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020765 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020768 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020771 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020773 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020776 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020782 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020785 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020787 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020790 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020792 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020795 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020798 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020800 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020803 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:19:37.411256 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020806 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020808 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020828 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020832 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020835 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020838 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020840 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020843 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020845 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020848 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020851 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020853 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020855 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020858 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020862 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020865 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020868 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020871 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020874 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020876 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:19:37.412087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.020879 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.021626 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.029668 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.029692 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.030583 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.030592 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030657 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030663 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030666 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030669 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030672 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030675 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030678 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030681 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030683 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:19:37.412705 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030686 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030688 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030691 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030693 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030696 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030699 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030701 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030704 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030706 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030709 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030713 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030716 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030719 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030721 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030724 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030727 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030729 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030732 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030734 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030737 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:19:37.413324 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030746 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030749 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030752 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030755 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030757 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030760 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030763 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030765 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030768 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030770 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030774 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030778 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030781 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030784 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030787 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030790 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030792 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030795 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030797 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030800 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:19:37.414157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030802 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030806 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030809 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030832 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030838 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030844 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030850 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030853 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030856 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030859 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030862 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030865 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030867 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030877 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030880 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030883 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030886 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030888 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030891 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:19:37.414786 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030893 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030896 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030916 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030923 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030926 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030930 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030933 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030936 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030939 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030942 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030944 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030947 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030949 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030952 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030955 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030957 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030960 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030962 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030964 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030967 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:19:37.415322 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030969 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030972 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030974 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030977 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030980 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030982 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030985 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030993 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030996 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.030998 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031000 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.031005 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031173 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031179 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031182 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 17:19:37.415916 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031186 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031189 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031193 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031195 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031198 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031201 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031203 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031206 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031210 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031213 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031215 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031218 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031220 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031223 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031226 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031228 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031231 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031235 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031239 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 17:19:37.416338 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031242 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031245 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031247 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031251 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031253 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031256 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031265 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031268 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031271 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031274 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031276 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031279 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031282 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031286 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031289 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031292 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031295 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031298 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031300 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031303 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 17:19:37.416886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031306 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031311 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031314 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031317 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031319 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031322 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031324 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031327 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031330 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031333 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031335 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031338 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031340 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031343 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031345 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031348 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031351 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031353 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031356 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031367 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 17:19:37.417416 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031370 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031373 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031375 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031378 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031380 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031384 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031387 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031390 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031392 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031396 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031400 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031402 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031405 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031409 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031412 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031415 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031418 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031420 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031423 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 17:19:37.418059 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031426 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031429 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031432 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031435 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031439 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031442 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031444 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031447 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031449 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031452 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031454 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031456 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031459 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031467 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031470 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031473 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031475 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 17:19:37.418568 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:37.031478 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.031484 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.031630 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.034033 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.035777 2579 server.go:1019] "Starting client certificate rotation" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.035845 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.035878 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.039046 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.042412 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.052770 2579 log.go:25] "Validated CRI v1 runtime API" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.055250 2579 log.go:25] "Validated CRI v1 image API" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.056229 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 17:19:37.419085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.061791 2579 fs.go:135] Filesystem UUIDs: map[55471c7d-31b9-4e12-bcba-6bbca400bfae:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c98b5691-532e-4d11-b581-e923ee579a55:/dev/nvme0n1p4] Jul 16 17:19:37.419433 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.061809 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 17:19:37.419530 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.068520 2579 manager.go:216] Machine: {Timestamp:2026-07-16 17:19:37.067152185 +0000 UTC m=+0.388368452 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100850 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec211907dcb838e0426cce5eb0b7e82e SystemUUID:ec211907-dcb8-38e0-426c-ce5eb0b7e82e BootID:51a2c1a4-dba2-4ac6-be37-91e9f6f8e7d1 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:87:a7:83:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:87:a7:83:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:8d:4f:31:5b:ce Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 17:19:37.419530 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.068630 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 17:19:37.419530 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.068731 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 17:19:37.419530 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.070639 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 17:19:37.419530 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.070665 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 17:19:37.419530 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.071033 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 17:19:37.419530 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.071520 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.071531 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.071539 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.072428 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.074286 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.077832 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.077966 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.077996 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.078006 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.078020 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.078030 2579 kubelet.go:398] "Adding apiserver pod source" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.078040 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.078477 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.078499 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.081179 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.083884 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.083915 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084074 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084088 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084094 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084099 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084107 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084113 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084776 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084782 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084793 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084799 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084807 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.084830 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.085732 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.085744 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.088740 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.088919 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.089001 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.090236 2579 server.go:1268] "Started kubelet" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.090249 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.090298 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.090352 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.091855 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 17:19:37.420086 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.092700 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.097564 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.099854 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-79.ec2.internal.18c2d4cc7ac361f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-79.ec2.internal,UID:ip-10-0-131-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-79.ec2.internal,},FirstTimestamp:2026-07-16 17:19:37.090179569 +0000 UTC m=+0.411395724,LastTimestamp:2026-07-16 17:19:37.090179569 +0000 UTC m=+0.411395724,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-79.ec2.internal,}" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.102646 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.102662 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.102712 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103358 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103376 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103362 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103445 2579 factory.go:55] Registering systemd factory Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103462 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103469 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103481 2579 factory.go:223] Registration of the systemd container factory successfully Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103712 2579 factory.go:153] Registering CRI-O factory Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103723 2579 factory.go:223] Registration of the crio container factory successfully Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103772 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103797 2579 factory.go:103] Registering Raw factory Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.103808 2579 manager.go:1196] Started watching for new ooms in manager Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.104836 2579 manager.go:349] Starting recovery of all containers Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.112558 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.112630 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.112967 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vdk7s" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.113211 2579 manager.go:354] Recovery completed Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.118468 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.120427 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.120454 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.120469 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.120523 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vdk7s" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.120986 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.120994 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.120997 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.121009 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 16 17:19:37.421254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.121641 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.121666 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.121676 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.122188 2579 policy_none.go:49] "None policy: Start" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.122200 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.122211 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.123322 2579 policy_none.go:47] "Start" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.190471 2579 manager.go:337] "Starting Device Plugin manager" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.190578 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.190595 2579 server.go:87] "Starting device plugin registration server" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.190868 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.190881 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.191041 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.191113 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.191303 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.191631 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.191686 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.210488 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.211748 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.211785 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.211807 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.211858 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.214341 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.291430 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.292541 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.292570 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.292581 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.292610 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.305570 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.305593 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-79.ec2.internal\": node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.312545 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal"] Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.312602 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.313449 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.313479 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.313489 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.314929 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.315055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.315087 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:19:37.502307 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.315987 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.316016 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.316028 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.316804 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.316847 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.316858 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.325905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.325936 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.326733 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.326756 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.326772 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.326787 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.374552 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-79.ec2.internal\" not found" node="ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.378102 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-79.ec2.internal\" not found" node="ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.404986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78da62831008a4094f14bd39dc637fe1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"78da62831008a4094f14bd39dc637fe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.405010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78da62831008a4094f14bd39dc637fe1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"78da62831008a4094f14bd39dc637fe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.405027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/822c3dc0fcba57a9f8441609f3e278a4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-79.ec2.internal\" (UID: \"822c3dc0fcba57a9f8441609f3e278a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.503558 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.431028 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.505457 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.505161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78da62831008a4094f14bd39dc637fe1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"78da62831008a4094f14bd39dc637fe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.505457 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.505201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78da62831008a4094f14bd39dc637fe1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"78da62831008a4094f14bd39dc637fe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.505457 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.505227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/822c3dc0fcba57a9f8441609f3e278a4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-79.ec2.internal\" (UID: \"822c3dc0fcba57a9f8441609f3e278a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.505457 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.505241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78da62831008a4094f14bd39dc637fe1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"78da62831008a4094f14bd39dc637fe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.505457 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.505305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78da62831008a4094f14bd39dc637fe1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"78da62831008a4094f14bd39dc637fe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.505457 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.505307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/822c3dc0fcba57a9f8441609f3e278a4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-79.ec2.internal\" (UID: \"822c3dc0fcba57a9f8441609f3e278a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.603047 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.531285 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.680399 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.632145 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.680399 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.676332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.681396 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:37.680967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" Jul 16 17:19:37.776272 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.732529 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.863792 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.833923 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:37.955200 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:37.935452 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:38.045155 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:38.036509 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:38.045155 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.036530 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 17:19:38.045155 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.036699 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 17:19:38.139115 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.124597 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:14:37 +0000 UTC" deadline="2027-12-12 21:31:07.806487972 +0000 UTC" Jul 16 17:19:38.139115 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.124633 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12340h11m29.681858329s" Jul 16 17:19:38.139115 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:38.136619 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:38.244049 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.215653 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:19:38.244049 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:38.237617 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:38.348530 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:38.339251 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:38.457543 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:38.440190 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found" Jul 16 17:19:38.457543 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.453133 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:19:38.526785 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.488533 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:19:38.526785 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.503172 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" Jul 16 17:19:38.526785 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.517430 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 17:19:38.526785 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.518517 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" Jul 16 17:19:38.529551 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.528963 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 17:19:38.611382 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:38.574722 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78da62831008a4094f14bd39dc637fe1.slice/crio-7c28c92e838f8144930a84c634725f2af1fcc568e2ffbba402570d2f00a03e9e WatchSource:0}: Error finding container 7c28c92e838f8144930a84c634725f2af1fcc568e2ffbba402570d2f00a03e9e: Status 404 returned error can't find the container with id 7c28c92e838f8144930a84c634725f2af1fcc568e2ffbba402570d2f00a03e9e Jul 16 17:19:38.611382 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:38.587492 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:19:39.078499 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.078456 2579 apiserver.go:52] "Watching apiserver" Jul 16 17:19:39.084117 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.084034 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 17:19:39.084564 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.084534 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-z4b9c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal","openshift-multus/multus-additional-cni-plugins-kp8cv","openshift-multus/network-metrics-daemon-pd47t","openshift-network-diagnostics/network-check-target-898mx","openshift-network-operator/iptables-alerter-vhf22","kube-system/konnectivity-agent-bbhj5","kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77","openshift-dns/node-resolver-dpq8m","openshift-multus/multus-pcxz5","openshift-ovn-kubernetes/ovnkube-node-zz6jt","kube-system/global-pull-secret-syncer-xjcjr","openshift-cluster-node-tuning-operator/tuned-6f4fd"] Jul 16 17:19:39.086355 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.086328 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.087511 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.087489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.088628 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.088395 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 17:19:39.088628 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.088479 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 17:19:39.088628 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.088624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ttt49\"" Jul 16 17:19:39.089047 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.089025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.089611 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.089571 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 17:19:39.089738 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.089718 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 17:19:39.089975 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.089960 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 17:19:39.090233 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.090198 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t8htz\"" Jul 16 17:19:39.090414 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.090366 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 17:19:39.090712 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.090696 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4nhjq\"" Jul 16 17:19:39.090770 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.090734 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 17:19:39.091029 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.091008 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 17:19:39.092112 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.091921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:39.092112 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.092014 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:39.093794 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.093773 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:39.093916 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.093877 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:39.095415 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.095382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.096810 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.096793 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.097275 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.097194 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 17:19:39.097606 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.097397 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 17:19:39.097606 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.097402 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pvg4j\"" Jul 16 17:19:39.097606 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.097431 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:19:39.098501 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.098471 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 17:19:39.098762 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.098744 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 17:19:39.102261 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.099268 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fqtkw\"" Jul 16 17:19:39.102261 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.099523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 17:19:39.102261 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.101305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.103414 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.103204 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:19:39.103582 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.103465 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 17:19:39.103582 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.103464 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qg2gs\"" Jul 16 17:19:39.103759 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.103615 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.103759 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.103630 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 17:19:39.105464 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.105434 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.106092 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.105872 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 17:19:39.106092 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.106057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 17:19:39.106570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.106551 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 17:19:39.106699 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.106679 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 17:19:39.107383 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.107068 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 17:19:39.107383 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.107169 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 17:19:39.107383 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.107284 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sq5rd\"" Jul 16 17:19:39.107383 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.107307 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:19:39.107968 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.107689 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 17:19:39.107968 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.107934 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 17:19:39.107968 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.107956 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 17:19:39.108140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.108036 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-66t9l\"" Jul 16 17:19:39.108962 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.108940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.109060 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.109012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:39.109245 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.109222 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 17:19:39.109350 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.109316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 17:19:39.109415 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.109356 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jkdds\"" Jul 16 17:19:39.113539 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-systemd-units\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.113652 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-cni-binary-copy\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.113652 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113578 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-kubelet\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.113652 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40d013ee-b9ca-43e4-8c41-32dd0c159036-iptables-alerter-script\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.113652 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrp4r\" (UniqueName: \"kubernetes.io/projected/ca64cb75-b54b-4422-848e-0eaf00776c4e-kube-api-access-vrp4r\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-hostroot\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-daemon-config\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113725 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovnkube-config\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113749 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-env-overrides\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xd42\" (UniqueName: \"kubernetes.io/projected/aacf733f-6183-473f-84a6-943e9d5a2f3b-kube-api-access-7xd42\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-system-cni-dir\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-modprobe-d\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113854 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysctl-d\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.113913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovn-node-metrics-cert\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-cni-binary-copy\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-sys-fs\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.113976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-systemd\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-sys\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-cnibin\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-socket-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-lib-modules\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-slash\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-system-cni-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-os-release\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-etc-kubernetes\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1a3b005-42b7-4098-8e5f-49da0a9abeed-hosts-file\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.114852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1a3b005-42b7-4098-8e5f-49da0a9abeed-tmp-dir\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhclg\" (UniqueName: \"kubernetes.io/projected/a1a3b005-42b7-4098-8e5f-49da0a9abeed-kube-api-access-nhclg\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-socket-dir-parent\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-k8s-cni-cncf-io\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-kubernetes\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114648 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-var-lib-kubelet\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-netns\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-systemd\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-ovn\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-node-log\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.115739 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovnkube-script-lib\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9549\" (UniqueName: \"kubernetes.io/projected/28b93950-4c7e-428e-bf79-aa152be2cee6-kube-api-access-s9549\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114821 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e0c60c3-8e2c-42ce-a438-767c1386938e-host\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114863 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-var-lib-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40d013ee-b9ca-43e4-8c41-32dd0c159036-host-slash\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-run\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-etc-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.114992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-cni-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-cnibin\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-log-socket\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e29f3d7-11a1-4505-9f47-561253c6ee96-tmp\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkwnl\" (UniqueName: \"kubernetes.io/projected/8e29f3d7-11a1-4505-9f47-561253c6ee96-kube-api-access-nkwnl\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115141 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-kubelet\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.116264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-cni-bin\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-cni-bin\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-device-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jb9x\" (UniqueName: \"kubernetes.io/projected/9e0c60c3-8e2c-42ce-a438-767c1386938e-kube-api-access-8jb9x\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w5f5\" (UniqueName: \"kubernetes.io/projected/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-kube-api-access-9w5f5\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhvvj\" (UniqueName: \"kubernetes.io/projected/40d013ee-b9ca-43e4-8c41-32dd0c159036-kube-api-access-rhvvj\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-conf-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-cni-netd\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-multus-certs\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-registration-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-tuned\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.116780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e0c60c3-8e2c-42ce-a438-767c1386938e-serviceca\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-cni-multus\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-run-netns\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxh8\" (UniqueName: \"kubernetes.io/projected/3ed64c3e-31de-468f-b826-5f5d63db7956-kube-api-access-lxxh8\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysctl-conf\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-os-release\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysconfig\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-host\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.117295 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.115904 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 17:19:39.147434 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.147409 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pv2lf" Jul 16 17:19:39.155536 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.155511 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pv2lf" Jul 16 17:19:39.205216 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.205173 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 17:19:39.209997 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.209959 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822c3dc0fcba57a9f8441609f3e278a4.slice/crio-0354ab9a4353ac49fb0e912b5c672c81c2f6c002db82e56ca00648d354d8796d WatchSource:0}: Error finding container 0354ab9a4353ac49fb0e912b5c672c81c2f6c002db82e56ca00648d354d8796d: Status 404 returned error can't find the container with id 0354ab9a4353ac49fb0e912b5c672c81c2f6c002db82e56ca00648d354d8796d Jul 16 17:19:39.216085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.216221 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-netns\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.216221 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-systemd\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216221 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-ovn\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216221 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-node-log\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216221 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216198 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-netns\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.216221 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovnkube-script-lib\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216221 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216216 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-systemd\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216243 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-ovn\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216279 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-node-log\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9549\" (UniqueName: \"kubernetes.io/projected/28b93950-4c7e-428e-bf79-aa152be2cee6-kube-api-access-s9549\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e0c60c3-8e2c-42ce-a438-767c1386938e-host\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-var-lib-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216356 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e0c60c3-8e2c-42ce-a438-767c1386938e-host\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40d013ee-b9ca-43e4-8c41-32dd0c159036-host-slash\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216394 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40d013ee-b9ca-43e4-8c41-32dd0c159036-host-slash\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216408 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-var-lib-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-run\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-etc-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-cni-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-cnibin\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.216649 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-log-socket\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e29f3d7-11a1-4505-9f47-561253c6ee96-tmp\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-run\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-etc-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkwnl\" (UniqueName: \"kubernetes.io/projected/8e29f3d7-11a1-4505-9f47-561253c6ee96-kube-api-access-nkwnl\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eff0c9f7-e23e-4243-9ff7-e7db4655a4f5-konnectivity-ca\") pod \"konnectivity-agent-bbhj5\" (UID: \"eff0c9f7-e23e-4243-9ff7-e7db4655a4f5\") " pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216619 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-cnibin\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216637 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-cni-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-kubelet\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216683 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-kubelet\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-cni-bin\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-cni-bin\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-device-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.217394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jb9x\" (UniqueName: \"kubernetes.io/projected/9e0c60c3-8e2c-42ce-a438-767c1386938e-kube-api-access-8jb9x\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w5f5\" (UniqueName: \"kubernetes.io/projected/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-kube-api-access-9w5f5\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216878 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-cni-bin\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhvvj\" (UniqueName: \"kubernetes.io/projected/40d013ee-b9ca-43e4-8c41-32dd0c159036-kube-api-access-rhvvj\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216923 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovnkube-script-lib\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216931 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-conf-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216963 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-cni-bin\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216927 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-log-socket\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.217084 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217188 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-device-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.216927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-conf-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" event={"ID":"822c3dc0fcba57a9f8441609f3e278a4","Type":"ContainerStarted","Data":"0354ab9a4353ac49fb0e912b5c672c81c2f6c002db82e56ca00648d354d8796d"} Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.217336 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs podName:28b93950-4c7e-428e-bf79-aa152be2cee6 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:39.717310507 +0000 UTC m=+3.038526668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs") pod "network-metrics-daemon-pd47t" (UID: "28b93950-4c7e-428e-bf79-aa152be2cee6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-cni-netd\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.218190 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-multus-certs\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-cni-netd\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-registration-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-tuned\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e0c60c3-8e2c-42ce-a438-767c1386938e-serviceca\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-multus-certs\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217593 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0823601-1c1f-4a81-9212-3ef17f75c8e3-kubelet-config\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-cni-multus\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217640 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-registration-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217525 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-run-netns\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217712 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-cni-multus\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.219034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217720 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxh8\" (UniqueName: \"kubernetes.io/projected/3ed64c3e-31de-468f-b826-5f5d63db7956-kube-api-access-lxxh8\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217789 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-run-netns\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysctl-conf\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-os-release\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysconfig\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-host\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eff0c9f7-e23e-4243-9ff7-e7db4655a4f5-agent-certs\") pod \"konnectivity-agent-bbhj5\" (UID: \"eff0c9f7-e23e-4243-9ff7-e7db4655a4f5\") " pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217958 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0823601-1c1f-4a81-9212-3ef17f75c8e3-dbus\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.217988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-systemd-units\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-cni-binary-copy\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-run-openvswitch\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.219726 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-kubelet\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40d013ee-b9ca-43e4-8c41-32dd0c159036-iptables-alerter-script\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrp4r\" (UniqueName: \"kubernetes.io/projected/ca64cb75-b54b-4422-848e-0eaf00776c4e-kube-api-access-vrp4r\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-hostroot\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-daemon-config\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovnkube-config\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-env-overrides\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xd42\" (UniqueName: \"kubernetes.io/projected/aacf733f-6183-473f-84a6-943e9d5a2f3b-kube-api-access-7xd42\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-system-cni-dir\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-modprobe-d\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218550 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysctl-d\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovn-node-metrics-cert\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-host\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-cni-binary-copy\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.220435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-sys-fs\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218677 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-systemd\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-sys\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-cnibin\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218821 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysctl-conf\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-socket-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-lib-modules\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-slash\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-socket-dir\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-system-cni-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-os-release\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219027 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-systemd-units\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-etc-kubernetes\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.221140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1a3b005-42b7-4098-8e5f-49da0a9abeed-hosts-file\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-os-release\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1a3b005-42b7-4098-8e5f-49da0a9abeed-tmp-dir\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhclg\" (UniqueName: \"kubernetes.io/projected/a1a3b005-42b7-4098-8e5f-49da0a9abeed-kube-api-access-nhclg\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219166 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-var-lib-kubelet\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-socket-dir-parent\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-k8s-cni-cncf-io\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219272 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-cni-binary-copy\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-system-cni-dir\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-kubernetes\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219409 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-var-lib-kubelet\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.221729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219506 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219533 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-var-lib-kubelet\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-slash\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysconfig\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40d013ee-b9ca-43e4-8c41-32dd0c159036-iptables-alerter-script\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.218186 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9e0c60c3-8e2c-42ce-a438-767c1386938e-serviceca\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" event={"ID":"78da62831008a4094f14bd39dc637fe1","Type":"ContainerStarted","Data":"7c28c92e838f8144930a84c634725f2af1fcc568e2ffbba402570d2f00a03e9e"} Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-etc-kubernetes\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220005 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-sysctl-d\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-system-cni-dir\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-os-release\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1a3b005-42b7-4098-8e5f-49da0a9abeed-hosts-file\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220206 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-modprobe-d\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-kubernetes\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-host-run-k8s-cni-cncf-io\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.222329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220422 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-daemon-config\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-hostroot\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220582 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1a3b005-42b7-4098-8e5f-49da0a9abeed-tmp-dir\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.219828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-lib-modules\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220724 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-systemd\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220766 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca64cb75-b54b-4422-848e-0eaf00776c4e-sys-fs\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e29f3d7-11a1-4505-9f47-561253c6ee96-sys\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220870 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacf733f-6183-473f-84a6-943e9d5a2f3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e29f3d7-11a1-4505-9f47-561253c6ee96-etc-tuned\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.220972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ed64c3e-31de-468f-b826-5f5d63db7956-cnibin\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.221047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-multus-socket-dir-parent\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.221066 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e29f3d7-11a1-4505-9f47-561253c6ee96-tmp\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.221122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovnkube-config\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.221389 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-cni-binary-copy\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.221505 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aacf733f-6183-473f-84a6-943e9d5a2f3b-env-overrides\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.222989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.222069 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ed64c3e-31de-468f-b826-5f5d63db7956-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.223762 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.222412 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aacf733f-6183-473f-84a6-943e9d5a2f3b-ovn-node-metrics-cert\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.225609 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.225530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jb9x\" (UniqueName: \"kubernetes.io/projected/9e0c60c3-8e2c-42ce-a438-767c1386938e-kube-api-access-8jb9x\") pod \"node-ca-z4b9c\" (UID: \"9e0c60c3-8e2c-42ce-a438-767c1386938e\") " pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.225609 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.225557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w5f5\" (UniqueName: \"kubernetes.io/projected/ff629c9b-796a-46cd-8e41-4b6f0d1ab530-kube-api-access-9w5f5\") pod \"multus-pcxz5\" (UID: \"ff629c9b-796a-46cd-8e41-4b6f0d1ab530\") " pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.225609 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.225584 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhvvj\" (UniqueName: \"kubernetes.io/projected/40d013ee-b9ca-43e4-8c41-32dd0c159036-kube-api-access-rhvvj\") pod \"iptables-alerter-vhf22\" (UID: \"40d013ee-b9ca-43e4-8c41-32dd0c159036\") " pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.226511 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.225841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkwnl\" (UniqueName: \"kubernetes.io/projected/8e29f3d7-11a1-4505-9f47-561253c6ee96-kube-api-access-nkwnl\") pod \"tuned-6f4fd\" (UID: \"8e29f3d7-11a1-4505-9f47-561253c6ee96\") " pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.226511 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.226435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9549\" (UniqueName: \"kubernetes.io/projected/28b93950-4c7e-428e-bf79-aa152be2cee6-kube-api-access-s9549\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:39.226710 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.226687 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxh8\" (UniqueName: \"kubernetes.io/projected/3ed64c3e-31de-468f-b826-5f5d63db7956-kube-api-access-lxxh8\") pod \"multus-additional-cni-plugins-kp8cv\" (UID: \"3ed64c3e-31de-468f-b826-5f5d63db7956\") " pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.227607 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.227573 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xd42\" (UniqueName: \"kubernetes.io/projected/aacf733f-6183-473f-84a6-943e9d5a2f3b-kube-api-access-7xd42\") pod \"ovnkube-node-zz6jt\" (UID: \"aacf733f-6183-473f-84a6-943e9d5a2f3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.229071 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.229053 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:19:39.229175 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.229075 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:19:39.229175 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.229086 2579 projected.go:196] Error preparing data for projected volume kube-api-access-95djt for pod openshift-network-diagnostics/network-check-target-898mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:39.229175 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.229153 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt podName:60f67669-e12d-4d64-9eda-478688b83664 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:39.72913508 +0000 UTC m=+3.050351224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-95djt" (UniqueName: "kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt") pod "network-check-target-898mx" (UID: "60f67669-e12d-4d64-9eda-478688b83664") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:39.232803 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.232779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrp4r\" (UniqueName: \"kubernetes.io/projected/ca64cb75-b54b-4422-848e-0eaf00776c4e-kube-api-access-vrp4r\") pod \"aws-ebs-csi-driver-node-sgx77\" (UID: \"ca64cb75-b54b-4422-848e-0eaf00776c4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.233146 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.233120 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhclg\" (UniqueName: \"kubernetes.io/projected/a1a3b005-42b7-4098-8e5f-49da0a9abeed-kube-api-access-nhclg\") pod \"node-resolver-dpq8m\" (UID: \"a1a3b005-42b7-4098-8e5f-49da0a9abeed\") " pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.320550 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.320511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eff0c9f7-e23e-4243-9ff7-e7db4655a4f5-konnectivity-ca\") pod \"konnectivity-agent-bbhj5\" (UID: \"eff0c9f7-e23e-4243-9ff7-e7db4655a4f5\") " pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:19:39.320744 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.320668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0823601-1c1f-4a81-9212-3ef17f75c8e3-kubelet-config\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.320744 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.320715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eff0c9f7-e23e-4243-9ff7-e7db4655a4f5-agent-certs\") pod \"konnectivity-agent-bbhj5\" (UID: \"eff0c9f7-e23e-4243-9ff7-e7db4655a4f5\") " pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:19:39.320873 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.320746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0823601-1c1f-4a81-9212-3ef17f75c8e3-dbus\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.320873 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.320711 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0823601-1c1f-4a81-9212-3ef17f75c8e3-kubelet-config\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.320873 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.320814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.321009 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.320907 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0823601-1c1f-4a81-9212-3ef17f75c8e3-dbus\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.321009 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.320918 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:39.321009 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.321003 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret podName:a0823601-1c1f-4a81-9212-3ef17f75c8e3 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:39.820968172 +0000 UTC m=+3.142184321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret") pod "global-pull-secret-syncer-xjcjr" (UID: "a0823601-1c1f-4a81-9212-3ef17f75c8e3") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:39.321205 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.321181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eff0c9f7-e23e-4243-9ff7-e7db4655a4f5-konnectivity-ca\") pod \"konnectivity-agent-bbhj5\" (UID: \"eff0c9f7-e23e-4243-9ff7-e7db4655a4f5\") " pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:19:39.323586 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.323564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eff0c9f7-e23e-4243-9ff7-e7db4655a4f5-agent-certs\") pod \"konnectivity-agent-bbhj5\" (UID: \"eff0c9f7-e23e-4243-9ff7-e7db4655a4f5\") " pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:19:39.354262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.354169 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 17:19:39.400276 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.400231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpq8m" Jul 16 17:19:39.410353 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.410320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pcxz5" Jul 16 17:19:39.410990 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.410953 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a3b005_42b7_4098_8e5f_49da0a9abeed.slice/crio-60fc0db437c216f7925ee05e8b73359c4c70f6af93ebdaf955703a9157e5a0c3 WatchSource:0}: Error finding container 60fc0db437c216f7925ee05e8b73359c4c70f6af93ebdaf955703a9157e5a0c3: Status 404 returned error can't find the container with id 60fc0db437c216f7925ee05e8b73359c4c70f6af93ebdaf955703a9157e5a0c3 Jul 16 17:19:39.419874 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.419843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" Jul 16 17:19:39.420157 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.420125 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff629c9b_796a_46cd_8e41_4b6f0d1ab530.slice/crio-da28a2ea180891b025054258572cea7fe0fb423dfa3da1e3fe8e66f9d60eeed5 WatchSource:0}: Error finding container da28a2ea180891b025054258572cea7fe0fb423dfa3da1e3fe8e66f9d60eeed5: Status 404 returned error can't find the container with id da28a2ea180891b025054258572cea7fe0fb423dfa3da1e3fe8e66f9d60eeed5 Jul 16 17:19:39.427620 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.427599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhf22" Jul 16 17:19:39.429888 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.429862 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed64c3e_31de_468f_b826_5f5d63db7956.slice/crio-89a9d804af635cf4e332cde3da71f62cd958bc082ccf39c9988d79fd1bee7ad8 WatchSource:0}: Error finding container 89a9d804af635cf4e332cde3da71f62cd958bc082ccf39c9988d79fd1bee7ad8: Status 404 returned error can't find the container with id 89a9d804af635cf4e332cde3da71f62cd958bc082ccf39c9988d79fd1bee7ad8 Jul 16 17:19:39.436629 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.436607 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" Jul 16 17:19:39.438296 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.438268 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d013ee_b9ca_43e4_8c41_32dd0c159036.slice/crio-3833aae03be7e440bf4b825a918623c7d09aaa1a537ce89b26e8aad93125af80 WatchSource:0}: Error finding container 3833aae03be7e440bf4b825a918623c7d09aaa1a537ce89b26e8aad93125af80: Status 404 returned error can't find the container with id 3833aae03be7e440bf4b825a918623c7d09aaa1a537ce89b26e8aad93125af80 Jul 16 17:19:39.443695 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.443668 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" Jul 16 17:19:39.446880 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.446852 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca64cb75_b54b_4422_848e_0eaf00776c4e.slice/crio-24db7d60fa6cef8cb8f72ce6afec5fee7edd71ecf91d7e54875f4218f7a96e6b WatchSource:0}: Error finding container 24db7d60fa6cef8cb8f72ce6afec5fee7edd71ecf91d7e54875f4218f7a96e6b: Status 404 returned error can't find the container with id 24db7d60fa6cef8cb8f72ce6afec5fee7edd71ecf91d7e54875f4218f7a96e6b Jul 16 17:19:39.450869 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.450843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:19:39.452943 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.452921 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e29f3d7_11a1_4505_9f47_561253c6ee96.slice/crio-e1ea8749f109ace36dff3e79b0095e5f139e4aee7443b4d3a0e1f8f375aa4cc3 WatchSource:0}: Error finding container e1ea8749f109ace36dff3e79b0095e5f139e4aee7443b4d3a0e1f8f375aa4cc3: Status 404 returned error can't find the container with id e1ea8749f109ace36dff3e79b0095e5f139e4aee7443b4d3a0e1f8f375aa4cc3 Jul 16 17:19:39.458226 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.458207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z4b9c" Jul 16 17:19:39.462599 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.462575 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacf733f_6183_473f_84a6_943e9d5a2f3b.slice/crio-2b231fa70e0c8ae0e9c4600df82358fcf8d527e4fc0bbb51f50e33400a23c12e WatchSource:0}: Error finding container 2b231fa70e0c8ae0e9c4600df82358fcf8d527e4fc0bbb51f50e33400a23c12e: Status 404 returned error can't find the container with id 2b231fa70e0c8ae0e9c4600df82358fcf8d527e4fc0bbb51f50e33400a23c12e Jul 16 17:19:39.463790 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.463620 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:19:39.469490 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.469468 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0c60c3_8e2c_42ce_a438_767c1386938e.slice/crio-a95b63e54b9e9622c70fc16f6ab943db78d447fd9ca9df1afb2b63ae7e0906a9 WatchSource:0}: Error finding container a95b63e54b9e9622c70fc16f6ab943db78d447fd9ca9df1afb2b63ae7e0906a9: Status 404 returned error can't find the container with id a95b63e54b9e9622c70fc16f6ab943db78d447fd9ca9df1afb2b63ae7e0906a9 Jul 16 17:19:39.472913 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:19:39.472827 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff0c9f7_e23e_4243_9ff7_e7db4655a4f5.slice/crio-8bc07e23c81f2c7ec945ee8df4cca654c4fcd535322473e1be6b40fa374857c5 WatchSource:0}: Error finding container 8bc07e23c81f2c7ec945ee8df4cca654c4fcd535322473e1be6b40fa374857c5: Status 404 returned error can't find the container with id 8bc07e23c81f2c7ec945ee8df4cca654c4fcd535322473e1be6b40fa374857c5 Jul 16 17:19:39.724322 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.724223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:39.724494 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.724370 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:39.724494 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.724446 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs podName:28b93950-4c7e-428e-bf79-aa152be2cee6 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:40.724427741 +0000 UTC m=+4.045643904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs") pod "network-metrics-daemon-pd47t" (UID: "28b93950-4c7e-428e-bf79-aa152be2cee6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:39.824956 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.824921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:39.824956 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:39.824961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:39.825165 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.825081 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:39.825165 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.825102 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:19:39.825165 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.825121 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:19:39.825165 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.825133 2579 projected.go:196] Error preparing data for projected volume kube-api-access-95djt for pod openshift-network-diagnostics/network-check-target-898mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:39.825165 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.825153 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret podName:a0823601-1c1f-4a81-9212-3ef17f75c8e3 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:40.825133321 +0000 UTC m=+4.146349481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret") pod "global-pull-secret-syncer-xjcjr" (UID: "a0823601-1c1f-4a81-9212-3ef17f75c8e3") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:39.825330 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:39.825171 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt podName:60f67669-e12d-4d64-9eda-478688b83664 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:40.825159842 +0000 UTC m=+4.146376002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-95djt" (UniqueName: "kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt") pod "network-check-target-898mx" (UID: "60f67669-e12d-4d64-9eda-478688b83664") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:40.158774 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.158584 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:14:39 +0000 UTC" deadline="2028-01-28 23:59:15.872230565 +0000 UTC" Jul 16 17:19:40.158774 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.158649 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13470h39m35.713585438s" Jul 16 17:19:40.234482 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.234311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bbhj5" event={"ID":"eff0c9f7-e23e-4243-9ff7-e7db4655a4f5","Type":"ContainerStarted","Data":"8bc07e23c81f2c7ec945ee8df4cca654c4fcd535322473e1be6b40fa374857c5"} Jul 16 17:19:40.239070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.238968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z4b9c" event={"ID":"9e0c60c3-8e2c-42ce-a438-767c1386938e","Type":"ContainerStarted","Data":"a95b63e54b9e9622c70fc16f6ab943db78d447fd9ca9df1afb2b63ae7e0906a9"} Jul 16 17:19:40.243439 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.243301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" event={"ID":"8e29f3d7-11a1-4505-9f47-561253c6ee96","Type":"ContainerStarted","Data":"e1ea8749f109ace36dff3e79b0095e5f139e4aee7443b4d3a0e1f8f375aa4cc3"} Jul 16 17:19:40.245486 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.245396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhf22" event={"ID":"40d013ee-b9ca-43e4-8c41-32dd0c159036","Type":"ContainerStarted","Data":"3833aae03be7e440bf4b825a918623c7d09aaa1a537ce89b26e8aad93125af80"} Jul 16 17:19:40.256679 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.256587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" event={"ID":"3ed64c3e-31de-468f-b826-5f5d63db7956","Type":"ContainerStarted","Data":"89a9d804af635cf4e332cde3da71f62cd958bc082ccf39c9988d79fd1bee7ad8"} Jul 16 17:19:40.266504 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.266399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pcxz5" event={"ID":"ff629c9b-796a-46cd-8e41-4b6f0d1ab530","Type":"ContainerStarted","Data":"da28a2ea180891b025054258572cea7fe0fb423dfa3da1e3fe8e66f9d60eeed5"} Jul 16 17:19:40.275151 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.275113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpq8m" event={"ID":"a1a3b005-42b7-4098-8e5f-49da0a9abeed","Type":"ContainerStarted","Data":"60fc0db437c216f7925ee05e8b73359c4c70f6af93ebdaf955703a9157e5a0c3"} Jul 16 17:19:40.288452 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.288407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"2b231fa70e0c8ae0e9c4600df82358fcf8d527e4fc0bbb51f50e33400a23c12e"} Jul 16 17:19:40.299799 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.299760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" event={"ID":"ca64cb75-b54b-4422-848e-0eaf00776c4e","Type":"ContainerStarted","Data":"24db7d60fa6cef8cb8f72ce6afec5fee7edd71ecf91d7e54875f4218f7a96e6b"} Jul 16 17:19:40.738178 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.737719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:40.738178 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:40.738028 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:40.738178 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:40.738111 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs podName:28b93950-4c7e-428e-bf79-aa152be2cee6 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:42.73808762 +0000 UTC m=+6.059303783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs") pod "network-metrics-daemon-pd47t" (UID: "28b93950-4c7e-428e-bf79-aa152be2cee6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:40.840356 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.839374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:40.840356 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:40.839425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:40.840356 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:40.839651 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:40.840356 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:40.839761 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret podName:a0823601-1c1f-4a81-9212-3ef17f75c8e3 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:42.83974166 +0000 UTC m=+6.160957806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret") pod "global-pull-secret-syncer-xjcjr" (UID: "a0823601-1c1f-4a81-9212-3ef17f75c8e3") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:40.840356 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:40.840206 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:19:40.840356 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:40.840226 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:19:40.840356 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:40.840239 2579 projected.go:196] Error preparing data for projected volume kube-api-access-95djt for pod openshift-network-diagnostics/network-check-target-898mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:40.840356 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:40.840316 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt podName:60f67669-e12d-4d64-9eda-478688b83664 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:42.840299918 +0000 UTC m=+6.161516073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-95djt" (UniqueName: "kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt") pod "network-check-target-898mx" (UID: "60f67669-e12d-4d64-9eda-478688b83664") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:41.158925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:41.158832 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:14:39 +0000 UTC" deadline="2027-12-20 18:41:29.244562751 +0000 UTC" Jul 16 17:19:41.158925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:41.158876 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12529h21m48.08569157s" Jul 16 17:19:41.214765 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:41.214731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:41.214945 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:41.214878 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:41.215317 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:41.215295 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:41.215459 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:41.215401 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:41.215520 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:41.215469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:41.215579 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:41.215557 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:41.310576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:41.310498 2579 generic.go:356] "Generic (PLEG): container finished" podID="78da62831008a4094f14bd39dc637fe1" containerID="488a0a73aa2772b4e81e8a65a53bbbc1630268e05085be99e70fb4b701d59106" exitCode=0 Jul 16 17:19:41.310576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:41.310557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" event={"ID":"78da62831008a4094f14bd39dc637fe1","Type":"ContainerDied","Data":"488a0a73aa2772b4e81e8a65a53bbbc1630268e05085be99e70fb4b701d59106"} Jul 16 17:19:42.347503 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:42.347416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" event={"ID":"78da62831008a4094f14bd39dc637fe1","Type":"ContainerStarted","Data":"d5725494ece7f893f6125f182ce4b5f678aac56d554aecf12fb06fd823ab0a4d"} Jul 16 17:19:42.361874 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:42.361795 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" podStartSLOduration=4.361774511 podStartE2EDuration="4.361774511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:19:42.361082847 +0000 UTC m=+5.682299048" watchObservedRunningTime="2026-07-16 17:19:42.361774511 +0000 UTC m=+5.682990677" Jul 16 17:19:42.756401 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:42.756308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:42.756561 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:42.756481 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:42.756561 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:42.756550 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs podName:28b93950-4c7e-428e-bf79-aa152be2cee6 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:46.756529652 +0000 UTC m=+10.077745796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs") pod "network-metrics-daemon-pd47t" (UID: "28b93950-4c7e-428e-bf79-aa152be2cee6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:42.857498 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:42.857454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:42.857658 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:42.857512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:42.857658 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:42.857637 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:42.857779 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:42.857697 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret podName:a0823601-1c1f-4a81-9212-3ef17f75c8e3 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:46.857680679 +0000 UTC m=+10.178896826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret") pod "global-pull-secret-syncer-xjcjr" (UID: "a0823601-1c1f-4a81-9212-3ef17f75c8e3") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:42.858135 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:42.858115 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:19:42.858215 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:42.858146 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:19:42.858215 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:42.858159 2579 projected.go:196] Error preparing data for projected volume kube-api-access-95djt for pod openshift-network-diagnostics/network-check-target-898mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:42.858215 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:42.858205 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt podName:60f67669-e12d-4d64-9eda-478688b83664 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:46.858189729 +0000 UTC m=+10.179405874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-95djt" (UniqueName: "kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt") pod "network-check-target-898mx" (UID: "60f67669-e12d-4d64-9eda-478688b83664") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:43.212979 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:43.212900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:43.213134 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:43.213056 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:43.213476 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:43.213448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:43.213578 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:43.213555 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:43.213640 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:43.213631 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:43.213722 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:43.213702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:45.212669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:45.212635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:45.213164 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:45.212901 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:45.213431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:45.213407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:45.213548 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:45.213515 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:45.213616 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:45.213568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:45.213736 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:45.213696 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:46.793573 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:46.793531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:46.794073 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:46.793698 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:46.794073 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:46.793783 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs podName:28b93950-4c7e-428e-bf79-aa152be2cee6 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:54.793762772 +0000 UTC m=+18.114978934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs") pod "network-metrics-daemon-pd47t" (UID: "28b93950-4c7e-428e-bf79-aa152be2cee6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:46.894957 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:46.894633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:46.894957 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:46.894680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:46.894957 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:46.894784 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:46.894957 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:46.894802 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:19:46.894957 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:46.894834 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:19:46.894957 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:46.894848 2579 projected.go:196] Error preparing data for projected volume kube-api-access-95djt for pod openshift-network-diagnostics/network-check-target-898mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:46.894957 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:46.894864 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret podName:a0823601-1c1f-4a81-9212-3ef17f75c8e3 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:54.894846333 +0000 UTC m=+18.216062490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret") pod "global-pull-secret-syncer-xjcjr" (UID: "a0823601-1c1f-4a81-9212-3ef17f75c8e3") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:46.894957 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:46.894885 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt podName:60f67669-e12d-4d64-9eda-478688b83664 nodeName:}" failed. No retries permitted until 2026-07-16 17:19:54.894874692 +0000 UTC m=+18.216090841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-95djt" (UniqueName: "kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt") pod "network-check-target-898mx" (UID: "60f67669-e12d-4d64-9eda-478688b83664") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:47.214259 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:47.213373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:47.214259 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:47.213495 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:47.214259 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:47.213902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:47.214259 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:47.214019 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:47.214259 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:47.214084 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:47.214259 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:47.214176 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:49.212501 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:49.212456 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:49.212993 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:49.212604 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:49.212993 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:49.212456 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:49.212993 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:49.212648 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:49.212993 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:49.212681 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:49.212993 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:49.212755 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:51.212612 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:51.212571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:51.212612 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:51.212592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:51.212612 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:51.212592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:51.213168 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:51.212704 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:51.213168 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:51.212789 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:51.213168 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:51.212948 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:53.212555 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:53.212517 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:53.213038 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:53.212587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:53.213038 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:53.212603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:53.213038 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:53.212699 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:53.213038 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:53.212788 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:53.213038 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:53.212874 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:54.860472 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:54.860430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:54.860900 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:54.860576 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:54.860900 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:54.860637 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs podName:28b93950-4c7e-428e-bf79-aa152be2cee6 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:10.860617775 +0000 UTC m=+34.181833918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs") pod "network-metrics-daemon-pd47t" (UID: "28b93950-4c7e-428e-bf79-aa152be2cee6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:19:54.961512 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:54.961471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:54.961512 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:54.961515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:54.961751 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:54.961631 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:54.961751 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:54.961647 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:19:54.961751 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:54.961673 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:19:54.961751 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:54.961686 2579 projected.go:196] Error preparing data for projected volume kube-api-access-95djt for pod openshift-network-diagnostics/network-check-target-898mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:54.961751 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:54.961688 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret podName:a0823601-1c1f-4a81-9212-3ef17f75c8e3 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:10.961674674 +0000 UTC m=+34.282890816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret") pod "global-pull-secret-syncer-xjcjr" (UID: "a0823601-1c1f-4a81-9212-3ef17f75c8e3") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:19:54.961751 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:54.961726 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt podName:60f67669-e12d-4d64-9eda-478688b83664 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:10.961715724 +0000 UTC m=+34.282931865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-95djt" (UniqueName: "kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt") pod "network-check-target-898mx" (UID: "60f67669-e12d-4d64-9eda-478688b83664") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:19:55.213081 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:55.212997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:55.213081 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:55.213043 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:55.213280 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:55.213013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:55.213280 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:55.213137 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:55.213280 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:55.213219 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:55.213408 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:55.213310 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:57.212721 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:57.212690 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:57.213191 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:57.212793 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:57.213191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:57.212848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:57.213191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:57.212865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:57.213191 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:57.212969 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:57.213191 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:57.213054 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:19:59.212380 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:59.212336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:19:59.212380 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:59.212375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:19:59.212934 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:19:59.212336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:19:59.212934 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:59.212470 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:19:59.212934 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:59.212513 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:19:59.212934 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:19:59.212593 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:00.389274 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.388810 2579 generic.go:356] "Generic (PLEG): container finished" podID="3ed64c3e-31de-468f-b826-5f5d63db7956" containerID="09b7396bf13b50b72d6165b741f548b92f528083267062116e9bcd4424098c2a" exitCode=0 Jul 16 17:20:00.390166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.388927 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" event={"ID":"3ed64c3e-31de-468f-b826-5f5d63db7956","Type":"ContainerDied","Data":"09b7396bf13b50b72d6165b741f548b92f528083267062116e9bcd4424098c2a"} Jul 16 17:20:00.391562 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.391537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pcxz5" event={"ID":"ff629c9b-796a-46cd-8e41-4b6f0d1ab530","Type":"ContainerStarted","Data":"74280ba69a919fedde4bc6dd7d44a7e6eecc11398a3b8d52bdaafa91f2660619"} Jul 16 17:20:00.394011 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.393982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpq8m" event={"ID":"a1a3b005-42b7-4098-8e5f-49da0a9abeed","Type":"ContainerStarted","Data":"1c46b8abfb2f0c4ccf65e9f4df21899070b0616234ee1ff9c3505bf31050c953"} Jul 16 17:20:00.395609 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.395586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" event={"ID":"822c3dc0fcba57a9f8441609f3e278a4","Type":"ContainerStarted","Data":"9af53c7a9b88e011fdfffe20d780f7625b456854d9a2b4e0c0ba9d0d668e01d1"} Jul 16 17:20:00.398849 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.398830 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:20:00.399191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.399166 2579 generic.go:356] "Generic (PLEG): container finished" podID="aacf733f-6183-473f-84a6-943e9d5a2f3b" containerID="0446fbab4fa393f6811b46efadf20cb2476064b310161742756b79a4a887783e" exitCode=1 Jul 16 17:20:00.399283 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.399244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"95bc5de8870ba0f0453fae08976912c41b1210f3f8e3054ddfe6f9a3be41eea3"} Jul 16 17:20:00.399342 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.399331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"b40eb6bfd9bb6a6ec7524c427d89c90f122b420f3de43c18ee3f09a870fc2e6b"} Jul 16 17:20:00.399407 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.399388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"a0149ad72291112c1175448ded0cce0bedc42970c8318f52503d11dae9ed04c7"} Jul 16 17:20:00.399463 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.399444 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"f9de825600f4d1eb054e6b0e87fd13dc7455c1e679b89e40a43a4550d2c4a394"} Jul 16 17:20:00.399513 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.399488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerDied","Data":"0446fbab4fa393f6811b46efadf20cb2476064b310161742756b79a4a887783e"} Jul 16 17:20:00.399570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.399536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"fb06a0b428edf63633261300814b595eed7e912e361d28a1bedc79c6b3ce490c"} Jul 16 17:20:00.401363 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.401329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" event={"ID":"ca64cb75-b54b-4422-848e-0eaf00776c4e","Type":"ContainerStarted","Data":"c138b8f7ac9c81dcdde75f2f79c9061bd6bf8aecb9299c470c98d02cea19a080"} Jul 16 17:20:00.402900 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.402879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bbhj5" event={"ID":"eff0c9f7-e23e-4243-9ff7-e7db4655a4f5","Type":"ContainerStarted","Data":"3fe56a7296670e9466e0e45a0c74352affabefc419d433bc19a0cba0bc4b0e90"} Jul 16 17:20:00.404580 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.404560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z4b9c" event={"ID":"9e0c60c3-8e2c-42ce-a438-767c1386938e","Type":"ContainerStarted","Data":"5e98c0798318019fb7c305b94e2256b07ac57d87bfa16820e533f47bae36bf6f"} Jul 16 17:20:00.406729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.406708 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" event={"ID":"8e29f3d7-11a1-4505-9f47-561253c6ee96","Type":"ContainerStarted","Data":"1bcad6cb4289c0e16afb508681511ca9f5dab71c574265ba009a05e7b16a1b21"} Jul 16 17:20:00.425664 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.425610 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" podStartSLOduration=22.425591915 podStartE2EDuration="22.425591915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:00.42507697 +0000 UTC m=+23.746293153" watchObservedRunningTime="2026-07-16 17:20:00.425591915 +0000 UTC m=+23.746808080" Jul 16 17:20:00.457088 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.457027 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dpq8m" podStartSLOduration=3.390378009 podStartE2EDuration="23.457004737s" totalImagesPullingTime="20.066626728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:00.440618366 +0000 UTC m=+23.761834531" watchObservedRunningTime="2026-07-16 17:20:00.457004737 +0000 UTC m=+23.778220900" Jul 16 17:20:00.457269 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.457118 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pcxz5" podStartSLOduration=3.398047734 podStartE2EDuration="23.457108267s" totalImagesPullingTime="20.059060533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:00.456655979 +0000 UTC m=+23.777872166" watchObservedRunningTime="2026-07-16 17:20:00.457108267 +0000 UTC m=+23.778324434" Jul 16 17:20:00.471312 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.471266 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6f4fd" podStartSLOduration=3.499213899 podStartE2EDuration="23.471251564s" totalImagesPullingTime="19.972037665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:00.47062404 +0000 UTC m=+23.791840225" watchObservedRunningTime="2026-07-16 17:20:00.471251564 +0000 UTC m=+23.792467728" Jul 16 17:20:00.484408 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.484344 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z4b9c" podStartSLOduration=3.479863063 podStartE2EDuration="23.48432618s" totalImagesPullingTime="20.004463117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:00.484172854 +0000 UTC m=+23.805389018" watchObservedRunningTime="2026-07-16 17:20:00.48432618 +0000 UTC m=+23.805542345" Jul 16 17:20:00.504212 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:00.504125 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bbhj5" podStartSLOduration=2.519482869 podStartE2EDuration="22.504111353s" totalImagesPullingTime="19.984628484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:00.504041913 +0000 UTC m=+23.825258078" watchObservedRunningTime="2026-07-16 17:20:00.504111353 +0000 UTC m=+23.825327517" Jul 16 17:20:01.168529 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.168492 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 17:20:01.203560 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.203433 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T17:20:01.168512752Z","UUID":"a9e3d00c-0b65-4310-a89b-b2c1d893e041","Handler":null,"Name":"","Endpoint":""} Jul 16 17:20:01.204851 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.204835 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 17:20:01.204956 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.204867 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 17:20:01.212912 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.212885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:01.212912 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.212897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:01.213073 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.212900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:01.213073 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:01.212979 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:20:01.213142 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:01.213077 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:01.213183 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:01.213163 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:20:01.410937 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.410852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhf22" event={"ID":"40d013ee-b9ca-43e4-8c41-32dd0c159036","Type":"ContainerStarted","Data":"52ca5f8d13e41576fa82af2a4802fc534eb75de0eb60aa7db50335522d9ed416"} Jul 16 17:20:01.412614 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.412593 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" event={"ID":"ca64cb75-b54b-4422-848e-0eaf00776c4e","Type":"ContainerStarted","Data":"2f9365d122d3c538f0480a08715b71cd3d4dd7b074ac98e7c4049369e929e3e1"} Jul 16 17:20:01.432997 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:01.432950 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vhf22" podStartSLOduration=4.398073663 podStartE2EDuration="24.43293617s" totalImagesPullingTime="20.034862507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:01.432189593 +0000 UTC m=+24.753405748" watchObservedRunningTime="2026-07-16 17:20:01.43293617 +0000 UTC m=+24.754152366" Jul 16 17:20:03.212911 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:03.212631 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:03.213392 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:03.212660 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:03.213392 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:03.212971 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:03.213392 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:03.213009 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:20:03.213392 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:03.212712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:03.213392 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:03.213081 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:20:03.420354 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:03.420327 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:20:03.420776 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:03.420742 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"dfb794f836045b3834fa0cb137c8420e08e1b2e24ebdef596d560560e861d91d"} Jul 16 17:20:03.422983 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:03.422955 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" event={"ID":"ca64cb75-b54b-4422-848e-0eaf00776c4e","Type":"ContainerStarted","Data":"459270abca785aff013622deea050c384aa09b2d9aac81ffb1260332fa9563f0"} Jul 16 17:20:03.439955 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:03.439905 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sgx77" podStartSLOduration=3.317195212 podStartE2EDuration="26.43988977s" totalImagesPullingTime="23.122694558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:03.439809929 +0000 UTC m=+26.761026107" watchObservedRunningTime="2026-07-16 17:20:03.43988977 +0000 UTC m=+26.761105963" Jul 16 17:20:04.943646 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:04.943611 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:20:04.944420 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:04.944402 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:20:05.212894 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:05.212856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:05.213090 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:05.212865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:05.213090 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:05.212991 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:20:05.213090 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:05.212865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:05.213220 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:05.213120 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:05.213220 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:05.213166 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:20:05.429071 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:05.429043 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:20:05.429715 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:05.429696 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bbhj5" Jul 16 17:20:06.432473 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:06.432441 2579 generic.go:356] "Generic (PLEG): container finished" podID="3ed64c3e-31de-468f-b826-5f5d63db7956" containerID="0844babff5cff1b83520487904a3267fe273ba0eb82dd8861a8f03acc4edbec6" exitCode=0 Jul 16 17:20:06.433311 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:06.432529 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" event={"ID":"3ed64c3e-31de-468f-b826-5f5d63db7956","Type":"ContainerDied","Data":"0844babff5cff1b83520487904a3267fe273ba0eb82dd8861a8f03acc4edbec6"} Jul 16 17:20:06.436378 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:06.436357 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:20:06.436797 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:06.436777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"053a9762fe6e70d4c1ca17582181acb99126bb36712ea770e7d7b93f9d4041f5"} Jul 16 17:20:06.437145 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:06.437131 2579 scope.go:117] "RemoveContainer" containerID="0446fbab4fa393f6811b46efadf20cb2476064b310161742756b79a4a887783e" Jul 16 17:20:07.213437 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.213405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:07.213612 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.213490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:07.213612 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.213536 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:07.213612 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:07.213543 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:20:07.213777 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:07.213625 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:07.213777 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:07.213711 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:20:07.444871 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.444844 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:20:07.445283 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.445260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" event={"ID":"aacf733f-6183-473f-84a6-943e9d5a2f3b","Type":"ContainerStarted","Data":"aaf78fc0b91c1a896e0c15eb7159e72955a1c05ec108d40fe7522f5cae849bf5"} Jul 16 17:20:07.445708 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.445531 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:20:07.445708 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.445606 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:20:07.445708 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.445653 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:20:07.464722 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.464635 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:20:07.465075 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.465051 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:20:07.472426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.472349 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" podStartSLOduration=10.333653415 podStartE2EDuration="30.472328225s" totalImagesPullingTime="20.13867481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:07.470857621 +0000 UTC m=+30.792073806" watchObservedRunningTime="2026-07-16 17:20:07.472328225 +0000 UTC m=+30.793544390" Jul 16 17:20:07.529591 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.529408 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pd47t"] Jul 16 17:20:07.529707 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.529697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:07.529867 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:07.529839 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:07.533475 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.533445 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-898mx"] Jul 16 17:20:07.533576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.533545 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:07.533668 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:07.533646 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:20:07.534110 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.534087 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xjcjr"] Jul 16 17:20:07.534230 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:07.534160 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:07.534292 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:07.534230 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:20:08.449316 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:08.449277 2579 generic.go:356] "Generic (PLEG): container finished" podID="3ed64c3e-31de-468f-b826-5f5d63db7956" containerID="33e9673e82157994090fe53e1496a44c648bf92f806b6efe4a35a85779ba6f75" exitCode=0 Jul 16 17:20:08.449672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:08.449358 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" event={"ID":"3ed64c3e-31de-468f-b826-5f5d63db7956","Type":"ContainerDied","Data":"33e9673e82157994090fe53e1496a44c648bf92f806b6efe4a35a85779ba6f75"} Jul 16 17:20:09.212209 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:09.212134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:09.212209 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:09.212145 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:09.212430 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:09.212245 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:09.212430 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:09.212306 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:20:09.212430 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:09.212351 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:09.212529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:09.212487 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:20:10.874110 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:10.874078 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:10.874650 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:10.874194 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:20:10.874650 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:10.874243 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs podName:28b93950-4c7e-428e-bf79-aa152be2cee6 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:42.874230539 +0000 UTC m=+66.195446682 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs") pod "network-metrics-daemon-pd47t" (UID: "28b93950-4c7e-428e-bf79-aa152be2cee6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 17:20:10.975247 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:10.975207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:10.975247 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:10.975244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:10.975449 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:10.975331 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 17:20:10.975449 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:10.975360 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 17:20:10.975449 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:10.975384 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret podName:a0823601-1c1f-4a81-9212-3ef17f75c8e3 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:42.975369437 +0000 UTC m=+66.296585579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret") pod "global-pull-secret-syncer-xjcjr" (UID: "a0823601-1c1f-4a81-9212-3ef17f75c8e3") : object "kube-system"/"original-pull-secret" not registered Jul 16 17:20:10.975449 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:10.975384 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 17:20:10.975449 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:10.975399 2579 projected.go:196] Error preparing data for projected volume kube-api-access-95djt for pod openshift-network-diagnostics/network-check-target-898mx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:20:10.975449 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:10.975420 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt podName:60f67669-e12d-4d64-9eda-478688b83664 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:42.975414748 +0000 UTC m=+66.296630890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-95djt" (UniqueName: "kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt") pod "network-check-target-898mx" (UID: "60f67669-e12d-4d64-9eda-478688b83664") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 17:20:11.212832 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:11.212736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:11.212832 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:11.212736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:11.213038 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:11.212736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:11.213038 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:11.212881 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:11.213038 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:11.213002 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:20:11.213144 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:11.213086 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:20:11.458473 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:11.458439 2579 generic.go:356] "Generic (PLEG): container finished" podID="3ed64c3e-31de-468f-b826-5f5d63db7956" containerID="78d7e2d0f60e4d8edb04bb68b668e24d5d92d999fd62f01b994d884547df2963" exitCode=0 Jul 16 17:20:11.458618 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:11.458524 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" event={"ID":"3ed64c3e-31de-468f-b826-5f5d63db7956","Type":"ContainerDied","Data":"78d7e2d0f60e4d8edb04bb68b668e24d5d92d999fd62f01b994d884547df2963"} Jul 16 17:20:13.212074 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.212030 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:13.212528 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.212030 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:13.212528 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.212179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:13.212528 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.212153 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-898mx" podUID="60f67669-e12d-4d64-9eda-478688b83664" Jul 16 17:20:13.212528 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.212319 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd47t" podUID="28b93950-4c7e-428e-bf79-aa152be2cee6" Jul 16 17:20:13.212528 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.212413 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xjcjr" podUID="a0823601-1c1f-4a81-9212-3ef17f75c8e3" Jul 16 17:20:13.477886 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.477852 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeReady" Jul 16 17:20:13.478062 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.478013 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 17:20:13.517400 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.517364 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c"] Jul 16 17:20:13.519340 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.519316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.520998 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.520974 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-sqx9h"] Jul 16 17:20:13.522386 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.521739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 17:20:13.524056 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.523883 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v2sdr\"" Jul 16 17:20:13.524195 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.524053 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.524266 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.524231 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 17:20:13.524385 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.524365 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd"] Jul 16 17:20:13.524493 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.524478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.526398 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.526380 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b7bc4f64d-dt8h4"] Jul 16 17:20:13.526520 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.526503 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd" Jul 16 17:20:13.529413 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.529386 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.529506 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.529444 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5plfl\"" Jul 16 17:20:13.529597 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.529450 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 17:20:13.529745 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.529399 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.530990 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.530668 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 17:20:13.532385 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.532367 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.532485 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.532375 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.532743 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.532722 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.533101 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.533083 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vljc2\"" Jul 16 17:20:13.533199 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.533172 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm"] Jul 16 17:20:13.534411 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.534263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.535764 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.535543 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr"] Jul 16 17:20:13.535764 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.535642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.536561 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.536542 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 17:20:13.537250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.537231 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt"] Jul 16 17:20:13.537367 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.537348 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.538249 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538231 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 16 17:20:13.538376 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538269 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 16 17:20:13.538376 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538376 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.538522 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538299 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 16 17:20:13.538522 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538286 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 16 17:20:13.538522 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538329 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.538678 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538632 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.538678 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538666 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5x6n8\"" Jul 16 17:20:13.538777 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538678 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 17:20:13.538777 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.538634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2m82d\"" Jul 16 17:20:13.539088 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.539072 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.539256 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.539241 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6544cd8c58-2wghd"] Jul 16 17:20:13.539314 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.539258 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 17:20:13.539364 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.539347 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:13.541046 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.541027 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz"] Jul 16 17:20:13.541169 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.541142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.543388 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.543366 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57df49f845-vg9nj"] Jul 16 17:20:13.543534 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.543515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz" Jul 16 17:20:13.544214 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.544192 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.544547 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.544529 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 17:20:13.546241 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.544933 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.546241 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.545309 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 17:20:13.546962 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.546688 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 17:20:13.547855 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.547834 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 16 17:20:13.548703 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.548685 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jj8sq\"" Jul 16 17:20:13.549125 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.548686 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 17:20:13.549242 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.549227 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.549753 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.549738 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.550163 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.550147 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c"] Jul 16 17:20:13.550302 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.550252 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-477wk\"" Jul 16 17:20:13.550431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.550410 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd"] Jul 16 17:20:13.550519 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.550450 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-sqx9h"] Jul 16 17:20:13.550519 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.550351 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.550630 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.550591 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9sbhl"] Jul 16 17:20:13.553454 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.553432 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b7bc4f64d-dt8h4"] Jul 16 17:20:13.556063 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.554416 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ns42w\"" Jul 16 17:20:13.556063 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.555003 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 17:20:13.556063 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.555007 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-89d6z\"" Jul 16 17:20:13.556063 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.555708 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.559139 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.559119 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.559907 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.559886 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt"] Jul 16 17:20:13.560101 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.560088 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f964c"] Jul 16 17:20:13.560857 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.560117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9sbhl" Jul 16 17:20:13.562975 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.562957 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 17:20:13.564070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.564053 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 17:20:13.564978 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.564958 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 17:20:13.566280 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.566265 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gbk4n\"" Jul 16 17:20:13.568103 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.568051 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr"] Jul 16 17:20:13.568227 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.568123 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6544cd8c58-2wghd"] Jul 16 17:20:13.568227 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.568145 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57df49f845-vg9nj"] Jul 16 17:20:13.568227 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.568124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.568868 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.568847 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 17:20:13.569027 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.568981 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm"] Jul 16 17:20:13.570699 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.570675 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sjk2m\"" Jul 16 17:20:13.570940 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.570742 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 17:20:13.572028 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.572007 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz"] Jul 16 17:20:13.574517 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.574497 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 17:20:13.579125 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.579104 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f964c"] Jul 16 17:20:13.579954 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.579906 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9sbhl"] Jul 16 17:20:13.694762 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.694722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-config\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.694762 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.694769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-trusted-ca\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.694988 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.694788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-bound-sa-token\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.694988 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.694812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fnd8\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-kube-api-access-2fnd8\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.694988 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.694850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndzdd\" (UniqueName: \"kubernetes.io/projected/d96ee708-7baf-4168-b489-c57038cf04ca-kube-api-access-ndzdd\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.694988 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.694895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-image-registry-private-configuration\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.695181 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.695181 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-bound-sa-token\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.695181 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695146 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85x7w\" (UniqueName: \"kubernetes.io/projected/15b2c949-fa93-4a22-bb20-bdf8c250d20a-kube-api-access-85x7w\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.695181 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtxsn\" (UniqueName: \"kubernetes.io/projected/16fadc42-e835-45ea-b1e3-9cd4656a73c8-kube-api-access-vtxsn\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.695338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr272\" (UniqueName: \"kubernetes.io/projected/90c8c6f6-8377-4672-8217-756ba6aaf696-kube-api-access-rr272\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:13.695338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.695338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695251 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-image-registry-private-configuration\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.695338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695276 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-installation-pull-secrets\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.695338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d96ee708-7baf-4168-b489-c57038cf04ca-config\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.695338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-certificates\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.695570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmgcr\" (UniqueName: \"kubernetes.io/projected/5808c6f0-e998-438e-ae9a-f0b24f69963b-kube-api-access-cmgcr\") pod \"network-check-source-869dcfcdcd-n4qmz\" (UID: \"5808c6f0-e998-438e-ae9a-f0b24f69963b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz" Jul 16 17:20:13.695570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.695570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0d20d5-de0d-4c23-b1c1-01d77d940101-ca-trust-extracted\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.695570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695444 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d44c547-b9b3-4cd8-984d-2141e733bd84-cert\") pod \"ingress-canary-9sbhl\" (UID: \"7d44c547-b9b3-4cd8-984d-2141e733bd84\") " pod="openshift-ingress-canary/ingress-canary-9sbhl" Jul 16 17:20:13.695570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk75c\" (UniqueName: \"kubernetes.io/projected/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-kube-api-access-kk75c\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.695570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-certificates\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.695570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwxr2\" (UniqueName: \"kubernetes.io/projected/7d44c547-b9b3-4cd8-984d-2141e733bd84-kube-api-access-mwxr2\") pod \"ingress-canary-9sbhl\" (UID: \"7d44c547-b9b3-4cd8-984d-2141e733bd84\") " pod="openshift-ingress-canary/ingress-canary-9sbhl" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695692 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-stats-auth\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-default-certificate\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-config-volume\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsc2d\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-kube-api-access-lsc2d\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.695915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/16fadc42-e835-45ea-b1e3-9cd4656a73c8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdn2c\" (UniqueName: \"kubernetes.io/projected/0b9376c1-6422-4886-93b3-9155ccaf7cb1-kube-api-access-kdn2c\") pod \"volume-data-source-validator-78495597f6-dtpvd\" (UID: \"0b9376c1-6422-4886-93b3-9155ccaf7cb1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.695972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d96ee708-7baf-4168-b489-c57038cf04ca-serving-cert\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-installation-pull-secrets\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-trusted-ca\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h29sk\" (UniqueName: \"kubernetes.io/projected/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-kube-api-access-h29sk\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-serving-cert\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsxqp\" (UniqueName: \"kubernetes.io/projected/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-kube-api-access-qsxqp\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-trusted-ca\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-tmp-dir\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.696262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.696257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860255e6-bcd3-4840-b625-f3f4f6af2502-ca-trust-extracted\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.797672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-tmp-dir\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.797672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860255e6-bcd3-4840-b625-f3f4f6af2502-ca-trust-extracted\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-config\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-trusted-ca\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-bound-sa-token\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fnd8\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-kube-api-access-2fnd8\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndzdd\" (UniqueName: \"kubernetes.io/projected/d96ee708-7baf-4168-b489-c57038cf04ca-kube-api-access-ndzdd\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-image-registry-private-configuration\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-bound-sa-token\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.797925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85x7w\" (UniqueName: \"kubernetes.io/projected/15b2c949-fa93-4a22-bb20-bdf8c250d20a-kube-api-access-85x7w\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtxsn\" (UniqueName: \"kubernetes.io/projected/16fadc42-e835-45ea-b1e3-9cd4656a73c8-kube-api-access-vtxsn\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr272\" (UniqueName: \"kubernetes.io/projected/90c8c6f6-8377-4672-8217-756ba6aaf696-kube-api-access-rr272\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.797981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-tmp-dir\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-image-registry-private-configuration\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-installation-pull-secrets\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d96ee708-7baf-4168-b489-c57038cf04ca-config\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-certificates\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmgcr\" (UniqueName: \"kubernetes.io/projected/5808c6f0-e998-438e-ae9a-f0b24f69963b-kube-api-access-cmgcr\") pod \"network-check-source-869dcfcdcd-n4qmz\" (UID: \"5808c6f0-e998-438e-ae9a-f0b24f69963b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0d20d5-de0d-4c23-b1c1-01d77d940101-ca-trust-extracted\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d44c547-b9b3-4cd8-984d-2141e733bd84-cert\") pod \"ingress-canary-9sbhl\" (UID: \"7d44c547-b9b3-4cd8-984d-2141e733bd84\") " pod="openshift-ingress-canary/ingress-canary-9sbhl" Jul 16 17:20:13.798290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk75c\" (UniqueName: \"kubernetes.io/projected/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-kube-api-access-kk75c\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.798855 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-certificates\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.798855 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.798855 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:13.798855 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwxr2\" (UniqueName: \"kubernetes.io/projected/7d44c547-b9b3-4cd8-984d-2141e733bd84-kube-api-access-mwxr2\") pod \"ingress-canary-9sbhl\" (UID: \"7d44c547-b9b3-4cd8-984d-2141e733bd84\") " pod="openshift-ingress-canary/ingress-canary-9sbhl" Jul 16 17:20:13.798855 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.798353 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:20:13.798855 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-stats-auth\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.799122 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.798453 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-config\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.799388 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.799462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-default-certificate\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.799494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-config-volume\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.799529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.799558 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:14.299538155 +0000 UTC m=+37.620754524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : configmap references non-existent config key: service-ca.crt Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.799600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.799620 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.799637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsc2d\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-kube-api-access-lsc2d\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.799740 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.799682 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls podName:0c0a9fe5-b012-46d4-9f21-e5a3a8592f19 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:14.299661644 +0000 UTC m=+37.620877795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls") pod "dns-default-f964c" (UID: "0c0a9fe5-b012-46d4-9f21-e5a3a8592f19") : secret "dns-default-metrics-tls" not found Jul 16 17:20:13.800274 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.799867 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.800274 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.800150 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:13.800274 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.800208 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-config-volume\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.800414 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.800304 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:14.300177375 +0000 UTC m=+37.621393525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : secret "router-metrics-certs-default" not found Jul 16 17:20:13.800414 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.800366 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls podName:16fadc42-e835-45ea-b1e3-9cd4656a73c8 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:14.300317692 +0000 UTC m=+37.621533835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9ffkm" (UID: "16fadc42-e835-45ea-b1e3-9cd4656a73c8") : secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:13.800534 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.800425 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-certificates\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.800534 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.800442 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:20:13.800534 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.800499 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls podName:90c8c6f6-8377-4672-8217-756ba6aaf696 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:14.300475982 +0000 UTC m=+37.621692141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls") pod "cluster-samples-operator-65db858894-6qhmt" (UID: "90c8c6f6-8377-4672-8217-756ba6aaf696") : secret "samples-operator-tls" not found Jul 16 17:20:13.801252 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.800695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-trusted-ca\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.801252 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.800830 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:13.801252 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.800843 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6544cd8c58-2wghd: secret "image-registry-tls" not found Jul 16 17:20:13.801252 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.800887 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls podName:860255e6-bcd3-4840-b625-f3f4f6af2502 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:14.300872902 +0000 UTC m=+37.622089044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls") pod "image-registry-6544cd8c58-2wghd" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502") : secret "image-registry-tls" not found Jul 16 17:20:13.802174 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.801940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0d20d5-de0d-4c23-b1c1-01d77d940101-ca-trust-extracted\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.802905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.802880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/16fadc42-e835-45ea-b1e3-9cd4656a73c8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.803011 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.802937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdn2c\" (UniqueName: \"kubernetes.io/projected/0b9376c1-6422-4886-93b3-9155ccaf7cb1-kube-api-access-kdn2c\") pod \"volume-data-source-validator-78495597f6-dtpvd\" (UID: \"0b9376c1-6422-4886-93b3-9155ccaf7cb1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd" Jul 16 17:20:13.803069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d96ee708-7baf-4168-b489-c57038cf04ca-serving-cert\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.803128 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-installation-pull-secrets\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.803128 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803088 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d96ee708-7baf-4168-b489-c57038cf04ca-config\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.803228 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-trusted-ca\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.803279 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h29sk\" (UniqueName: \"kubernetes.io/projected/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-kube-api-access-h29sk\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.803329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-serving-cert\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.803377 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsxqp\" (UniqueName: \"kubernetes.io/projected/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-kube-api-access-qsxqp\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.803433 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-trusted-ca\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.803715 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.803954 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.803930 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:13.804020 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.803958 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57df49f845-vg9nj: secret "image-registry-tls" not found Jul 16 17:20:13.804020 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.803958 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/16fadc42-e835-45ea-b1e3-9cd4656a73c8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.804111 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:13.804096 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls podName:de0d20d5-de0d-4c23-b1c1-01d77d940101 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:14.304057277 +0000 UTC m=+37.625273437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls") pod "image-registry-57df49f845-vg9nj" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101") : secret "image-registry-tls" not found Jul 16 17:20:13.811685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.806601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-certificates\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.811685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.808195 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-trusted-ca\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.811685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.808413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-default-certificate\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.811685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.809221 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-stats-auth\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.811685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.810663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860255e6-bcd3-4840-b625-f3f4f6af2502-ca-trust-extracted\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.811685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.811312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-trusted-ca\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.812080 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.811990 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.812441 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.812377 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-installation-pull-secrets\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.813747 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.813721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-image-registry-private-configuration\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.815609 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.815559 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdn2c\" (UniqueName: \"kubernetes.io/projected/0b9376c1-6422-4886-93b3-9155ccaf7cb1-kube-api-access-kdn2c\") pod \"volume-data-source-validator-78495597f6-dtpvd\" (UID: \"0b9376c1-6422-4886-93b3-9155ccaf7cb1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd" Jul 16 17:20:13.816044 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.816020 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fnd8\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-kube-api-access-2fnd8\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.816517 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.816494 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d96ee708-7baf-4168-b489-c57038cf04ca-serving-cert\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.816600 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.816543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-serving-cert\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.817494 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwxr2\" (UniqueName: \"kubernetes.io/projected/7d44c547-b9b3-4cd8-984d-2141e733bd84-kube-api-access-mwxr2\") pod \"ingress-canary-9sbhl\" (UID: \"7d44c547-b9b3-4cd8-984d-2141e733bd84\") " pod="openshift-ingress-canary/ingress-canary-9sbhl" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.817696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d44c547-b9b3-4cd8-984d-2141e733bd84-cert\") pod \"ingress-canary-9sbhl\" (UID: \"7d44c547-b9b3-4cd8-984d-2141e733bd84\") " pod="openshift-ingress-canary/ingress-canary-9sbhl" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.817850 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtxsn\" (UniqueName: \"kubernetes.io/projected/16fadc42-e835-45ea-b1e3-9cd4656a73c8-kube-api-access-vtxsn\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.818016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-bound-sa-token\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.818087 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr272\" (UniqueName: \"kubernetes.io/projected/90c8c6f6-8377-4672-8217-756ba6aaf696-kube-api-access-rr272\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.818234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h29sk\" (UniqueName: \"kubernetes.io/projected/a72ed6e5-f053-4fff-8d44-e75c4a6191ce-kube-api-access-h29sk\") pod \"console-operator-7866497494-sqx9h\" (UID: \"a72ed6e5-f053-4fff-8d44-e75c4a6191ce\") " pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.818236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-bound-sa-token\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.818474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-installation-pull-secrets\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.818526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85x7w\" (UniqueName: \"kubernetes.io/projected/15b2c949-fa93-4a22-bb20-bdf8c250d20a-kube-api-access-85x7w\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:13.818672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.818603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-image-registry-private-configuration\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:13.819166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.818692 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndzdd\" (UniqueName: \"kubernetes.io/projected/d96ee708-7baf-4168-b489-c57038cf04ca-kube-api-access-ndzdd\") pod \"service-ca-operator-7695fc6c8c-lzm4c\" (UID: \"d96ee708-7baf-4168-b489-c57038cf04ca\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.819166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.819147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsc2d\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-kube-api-access-lsc2d\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:13.819741 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.819722 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsxqp\" (UniqueName: \"kubernetes.io/projected/8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e-kube-api-access-qsxqp\") pod \"kube-storage-version-migrator-operator-799cb7f958-kg2zr\" (UID: \"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.819854 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.819801 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk75c\" (UniqueName: \"kubernetes.io/projected/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-kube-api-access-kk75c\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:13.821166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.821141 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmgcr\" (UniqueName: \"kubernetes.io/projected/5808c6f0-e998-438e-ae9a-f0b24f69963b-kube-api-access-cmgcr\") pod \"network-check-source-869dcfcdcd-n4qmz\" (UID: \"5808c6f0-e998-438e-ae9a-f0b24f69963b\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz" Jul 16 17:20:13.840228 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.840107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" Jul 16 17:20:13.848037 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.847996 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:13.862997 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.862972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd" Jul 16 17:20:13.893512 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.893466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" Jul 16 17:20:13.917451 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.917202 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz" Jul 16 17:20:13.930918 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:13.930714 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9sbhl" Jul 16 17:20:14.015716 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.015683 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-sqx9h"] Jul 16 17:20:14.018422 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.018394 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c"] Jul 16 17:20:14.026147 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.026112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd"] Jul 16 17:20:14.309756 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.309712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.309766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.309897 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.309914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.309956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.309976 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls podName:16fadc42-e835-45ea-b1e3-9cd4656a73c8 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:15.309955063 +0000 UTC m=+38.631171208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9ffkm" (UID: "16fadc42-e835-45ea-b1e3-9cd4656a73c8") : secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.309897 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310025 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310039 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310052 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6544cd8c58-2wghd: secret "image-registry-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.310053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310078 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls podName:0c0a9fe5-b012-46d4-9f21-e5a3a8592f19 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:15.310059896 +0000 UTC m=+38.631276043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls") pod "dns-default-f964c" (UID: "0c0a9fe5-b012-46d4-9f21-e5a3a8592f19") : secret "dns-default-metrics-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310102 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls podName:90c8c6f6-8377-4672-8217-756ba6aaf696 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:15.310092724 +0000 UTC m=+38.631308872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls") pod "cluster-samples-operator-65db858894-6qhmt" (UID: "90c8c6f6-8377-4672-8217-756ba6aaf696") : secret "samples-operator-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310116 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:14.310236 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310128 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls podName:860255e6-bcd3-4840-b625-f3f4f6af2502 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:15.3101207 +0000 UTC m=+38.631336868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls") pod "image-registry-6544cd8c58-2wghd" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502") : secret "image-registry-tls" not found Jul 16 17:20:14.310806 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310129 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57df49f845-vg9nj: secret "image-registry-tls" not found Jul 16 17:20:14.310806 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310177 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls podName:de0d20d5-de0d-4c23-b1c1-01d77d940101 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:15.310161509 +0000 UTC m=+38.631377669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls") pod "image-registry-57df49f845-vg9nj" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101") : secret "image-registry-tls" not found Jul 16 17:20:14.310806 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.310196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:14.310806 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:14.310264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:14.310806 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310368 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:20:14.310806 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310385 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:15.310373454 +0000 UTC m=+38.631589597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : configmap references non-existent config key: service-ca.crt Jul 16 17:20:14.310806 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:14.310412 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:15.310397964 +0000 UTC m=+38.631614109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : secret "router-metrics-certs-default" not found Jul 16 17:20:15.212748 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.212584 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:15.212939 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.212794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:15.213836 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.213358 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:15.215050 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.215024 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 17:20:15.215568 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.215545 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-grt9w\"" Jul 16 17:20:15.215666 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.215572 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 17:20:15.215666 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.215614 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vnxgq\"" Jul 16 17:20:15.318923 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.318883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.318953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.318999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.319056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319075 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.319087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319100 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57df49f845-vg9nj: secret "image-registry-tls" not found Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.319122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319166 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:17.319146725 +0000 UTC m=+40.640362881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : configmap references non-existent config key: service-ca.crt Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.319153 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319084 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319206 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls podName:de0d20d5-de0d-4c23-b1c1-01d77d940101 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:17.319188236 +0000 UTC m=+40.640404381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls") pod "image-registry-57df49f845-vg9nj" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101") : secret "image-registry-tls" not found Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319216 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319234 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:17.319225451 +0000 UTC m=+40.640441595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : secret "router-metrics-certs-default" not found Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319236 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:15.319382 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319178 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:15.320152 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319248 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6544cd8c58-2wghd: secret "image-registry-tls" not found Jul 16 17:20:15.320152 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319252 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls podName:0c0a9fe5-b012-46d4-9f21-e5a3a8592f19 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:17.319244744 +0000 UTC m=+40.640460886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls") pod "dns-default-f964c" (UID: "0c0a9fe5-b012-46d4-9f21-e5a3a8592f19") : secret "dns-default-metrics-tls" not found Jul 16 17:20:15.320152 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319281 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls podName:16fadc42-e835-45ea-b1e3-9cd4656a73c8 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:17.319267104 +0000 UTC m=+40.640483260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9ffkm" (UID: "16fadc42-e835-45ea-b1e3-9cd4656a73c8") : secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:15.320152 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319281 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:20:15.320152 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319344 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls podName:860255e6-bcd3-4840-b625-f3f4f6af2502 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:17.319312657 +0000 UTC m=+40.640528805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls") pod "image-registry-6544cd8c58-2wghd" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502") : secret "image-registry-tls" not found Jul 16 17:20:15.320152 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:15.319375 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls podName:90c8c6f6-8377-4672-8217-756ba6aaf696 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:17.319365481 +0000 UTC m=+40.640581634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls") pod "cluster-samples-operator-65db858894-6qhmt" (UID: "90c8c6f6-8377-4672-8217-756ba6aaf696") : secret "samples-operator-tls" not found Jul 16 17:20:15.425975 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.425922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:15.438053 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:15.438014 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9376c1_6422_4886_93b3_9155ccaf7cb1.slice/crio-0f578a8355abf4f8434a62339c602d7d4f8153ecc84014cf3f48869608f42d31 WatchSource:0}: Error finding container 0f578a8355abf4f8434a62339c602d7d4f8153ecc84014cf3f48869608f42d31: Status 404 returned error can't find the container with id 0f578a8355abf4f8434a62339c602d7d4f8153ecc84014cf3f48869608f42d31 Jul 16 17:20:15.439548 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:15.439519 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72ed6e5_f053_4fff_8d44_e75c4a6191ce.slice/crio-6e98a898120df141d5d7b8ed0659803e1b24cd076670ea0edceaaa9245b861ce WatchSource:0}: Error finding container 6e98a898120df141d5d7b8ed0659803e1b24cd076670ea0edceaaa9245b861ce: Status 404 returned error can't find the container with id 6e98a898120df141d5d7b8ed0659803e1b24cd076670ea0edceaaa9245b861ce Jul 16 17:20:15.440462 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:15.440433 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96ee708_7baf_4168_b489_c57038cf04ca.slice/crio-f7e279823bffa35a9f483a24b2cf1bb528f48c04bfe0df34da9c3b03cd72fec4 WatchSource:0}: Error finding container f7e279823bffa35a9f483a24b2cf1bb528f48c04bfe0df34da9c3b03cd72fec4: Status 404 returned error can't find the container with id f7e279823bffa35a9f483a24b2cf1bb528f48c04bfe0df34da9c3b03cd72fec4 Jul 16 17:20:15.470334 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.470040 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd" event={"ID":"0b9376c1-6422-4886-93b3-9155ccaf7cb1","Type":"ContainerStarted","Data":"0f578a8355abf4f8434a62339c602d7d4f8153ecc84014cf3f48869608f42d31"} Jul 16 17:20:15.474670 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.474587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sqx9h" event={"ID":"a72ed6e5-f053-4fff-8d44-e75c4a6191ce","Type":"ContainerStarted","Data":"6e98a898120df141d5d7b8ed0659803e1b24cd076670ea0edceaaa9245b861ce"} Jul 16 17:20:15.476011 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.475972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" event={"ID":"d96ee708-7baf-4168-b489-c57038cf04ca","Type":"ContainerStarted","Data":"f7e279823bffa35a9f483a24b2cf1bb528f48c04bfe0df34da9c3b03cd72fec4"} Jul 16 17:20:15.522806 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.522303 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:15.647282 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.647255 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz"] Jul 16 17:20:15.651592 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.651565 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr"] Jul 16 17:20:15.668079 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:15.668044 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9sbhl"] Jul 16 17:20:15.671106 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:15.671078 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e42c4c3_e5f0_4f39_bbc0_c61c3ed9f31e.slice/crio-3f8b9caf67933b925351b995950040da5a945df9ff48d558c606009612d98419 WatchSource:0}: Error finding container 3f8b9caf67933b925351b995950040da5a945df9ff48d558c606009612d98419: Status 404 returned error can't find the container with id 3f8b9caf67933b925351b995950040da5a945df9ff48d558c606009612d98419 Jul 16 17:20:15.671881 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:15.671856 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d44c547_b9b3_4cd8_984d_2141e733bd84.slice/crio-f5e2291d7df62464ae3a4823a062eda2f040d078473557b101071b6a2061766b WatchSource:0}: Error finding container f5e2291d7df62464ae3a4823a062eda2f040d078473557b101071b6a2061766b: Status 404 returned error can't find the container with id f5e2291d7df62464ae3a4823a062eda2f040d078473557b101071b6a2061766b Jul 16 17:20:15.672440 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:15.672410 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5808c6f0_e998_438e_ae9a_f0b24f69963b.slice/crio-7bac319aa8aa7efacaf23d3732e2baaa09144db52c79a027ce84c8ff0e4d1501 WatchSource:0}: Error finding container 7bac319aa8aa7efacaf23d3732e2baaa09144db52c79a027ce84c8ff0e4d1501: Status 404 returned error can't find the container with id 7bac319aa8aa7efacaf23d3732e2baaa09144db52c79a027ce84c8ff0e4d1501 Jul 16 17:20:16.481132 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:16.481085 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz" event={"ID":"5808c6f0-e998-438e-ae9a-f0b24f69963b","Type":"ContainerStarted","Data":"7bac319aa8aa7efacaf23d3732e2baaa09144db52c79a027ce84c8ff0e4d1501"} Jul 16 17:20:16.482983 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:16.482952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9sbhl" event={"ID":"7d44c547-b9b3-4cd8-984d-2141e733bd84","Type":"ContainerStarted","Data":"f5e2291d7df62464ae3a4823a062eda2f040d078473557b101071b6a2061766b"} Jul 16 17:20:16.487427 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:16.487399 2579 generic.go:356] "Generic (PLEG): container finished" podID="3ed64c3e-31de-468f-b826-5f5d63db7956" containerID="859a77b7d9b6c27a598397ea238944d42368c2cf008f3f0469c4c7b597c45761" exitCode=0 Jul 16 17:20:16.487538 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:16.487475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" event={"ID":"3ed64c3e-31de-468f-b826-5f5d63db7956","Type":"ContainerDied","Data":"859a77b7d9b6c27a598397ea238944d42368c2cf008f3f0469c4c7b597c45761"} Jul 16 17:20:16.490117 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:16.490087 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" event={"ID":"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e","Type":"ContainerStarted","Data":"3f8b9caf67933b925351b995950040da5a945df9ff48d558c606009612d98419"} Jul 16 17:20:17.027023 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.026971 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:17.093481 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.093424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:17.342930 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.342832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:17.342930 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.342914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:17.343137 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.342960 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:17.343137 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.342975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:17.343137 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.343038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:17.343137 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.343066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:17.343282 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.342980 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57df49f845-vg9nj: secret "image-registry-tls" not found Jul 16 17:20:17.343282 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343081 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:20:17.343282 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343192 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:20:17.343282 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343118 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:21.343098074 +0000 UTC m=+44.664314215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : configmap references non-existent config key: service-ca.crt Jul 16 17:20:17.343282 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.343231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:17.343282 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343237 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls podName:90c8c6f6-8377-4672-8217-756ba6aaf696 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:21.343224658 +0000 UTC m=+44.664440823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls") pod "cluster-samples-operator-65db858894-6qhmt" (UID: "90c8c6f6-8377-4672-8217-756ba6aaf696") : secret "samples-operator-tls" not found Jul 16 17:20:17.343282 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.343266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343296 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343326 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls podName:0c0a9fe5-b012-46d4-9f21-e5a3a8592f19 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:21.34331592 +0000 UTC m=+44.664532064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls") pod "dns-default-f964c" (UID: "0c0a9fe5-b012-46d4-9f21-e5a3a8592f19") : secret "dns-default-metrics-tls" not found Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343154 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343365 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls podName:16fadc42-e835-45ea-b1e3-9cd4656a73c8 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:21.343354642 +0000 UTC m=+44.664570788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9ffkm" (UID: "16fadc42-e835-45ea-b1e3-9cd4656a73c8") : secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343382 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls podName:de0d20d5-de0d-4c23-b1c1-01d77d940101 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:21.343373621 +0000 UTC m=+44.664589768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls") pod "image-registry-57df49f845-vg9nj" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101") : secret "image-registry-tls" not found Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343385 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343395 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6544cd8c58-2wghd: secret "image-registry-tls" not found Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343396 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:21.343388132 +0000 UTC m=+44.664604282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : secret "router-metrics-certs-default" not found Jul 16 17:20:17.343529 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:17.343429 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls podName:860255e6-bcd3-4840-b625-f3f4f6af2502 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:21.343413921 +0000 UTC m=+44.664630077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls") pod "image-registry-6544cd8c58-2wghd" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502") : secret "image-registry-tls" not found Jul 16 17:20:17.458119 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.458076 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:17.497308 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.497252 2579 generic.go:356] "Generic (PLEG): container finished" podID="3ed64c3e-31de-468f-b826-5f5d63db7956" containerID="0b211ea3e8b8be3714c237128eef09f19294b9fe4838f2e38f2597c03bbeaf31" exitCode=0 Jul 16 17:20:17.497308 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.497289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" event={"ID":"3ed64c3e-31de-468f-b826-5f5d63db7956","Type":"ContainerDied","Data":"0b211ea3e8b8be3714c237128eef09f19294b9fe4838f2e38f2597c03bbeaf31"} Jul 16 17:20:17.524205 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:17.524170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:21.386358 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:21.386310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:21.386358 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:21.386375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:21.386435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386484 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386548 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386562 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls podName:0c0a9fe5-b012-46d4-9f21-e5a3a8592f19 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:29.386539919 +0000 UTC m=+52.707756077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls") pod "dns-default-f964c" (UID: "0c0a9fe5-b012-46d4-9f21-e5a3a8592f19") : secret "dns-default-metrics-tls" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386562 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6544cd8c58-2wghd: secret "image-registry-tls" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386593 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386609 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls podName:860255e6-bcd3-4840-b625-f3f4f6af2502 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:29.386598565 +0000 UTC m=+52.707814779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls") pod "image-registry-6544cd8c58-2wghd" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502") : secret "image-registry-tls" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386627 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386638 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57df49f845-vg9nj: secret "image-registry-tls" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386643 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:29.386631326 +0000 UTC m=+52.707847473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : secret "router-metrics-certs-default" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:21.386490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386671 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls podName:de0d20d5-de0d-4c23-b1c1-01d77d940101 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:29.386660655 +0000 UTC m=+52.707876806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls") pod "image-registry-57df49f845-vg9nj" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101") : secret "image-registry-tls" not found Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:21.386729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:21.386907 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:21.386776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:21.387459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:21.386796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:21.387459 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386896 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:20:21.387459 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386932 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls podName:90c8c6f6-8377-4672-8217-756ba6aaf696 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:29.386921171 +0000 UTC m=+52.708137313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls") pod "cluster-samples-operator-65db858894-6qhmt" (UID: "90c8c6f6-8377-4672-8217-756ba6aaf696") : secret "samples-operator-tls" not found Jul 16 17:20:21.387459 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386932 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:21.387459 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386946 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:29.386939135 +0000 UTC m=+52.708155279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : configmap references non-existent config key: service-ca.crt Jul 16 17:20:21.387459 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:21.386995 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls podName:16fadc42-e835-45ea-b1e3-9cd4656a73c8 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:29.386980685 +0000 UTC m=+52.708196834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9ffkm" (UID: "16fadc42-e835-45ea-b1e3-9cd4656a73c8") : secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:23.515526 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.515451 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" event={"ID":"d96ee708-7baf-4168-b489-c57038cf04ca","Type":"ContainerStarted","Data":"15c25d1f3c8d1f625c58c3c1d93282de67ccc31e914c8038e18166bebaaabde8"} Jul 16 17:20:23.519568 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.519541 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" event={"ID":"3ed64c3e-31de-468f-b826-5f5d63db7956","Type":"ContainerStarted","Data":"6b43533a6c6a449e87bdb7b758b13c95080532a0ddee5db1f6579a646421d20d"} Jul 16 17:20:23.521161 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.521131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" event={"ID":"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e","Type":"ContainerStarted","Data":"5d09204752a8b1077f1017dfd53130c993ad08f8647bb585d147c137834b7354"} Jul 16 17:20:23.522777 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.522759 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/0.log" Jul 16 17:20:23.522905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.522791 2579 generic.go:356] "Generic (PLEG): container finished" podID="a72ed6e5-f053-4fff-8d44-e75c4a6191ce" containerID="ddd5220d288b4eac710b2a8ea4ec37bab032262f9ab3eafb683ff59666d2fd77" exitCode=255 Jul 16 17:20:23.522905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.522884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sqx9h" event={"ID":"a72ed6e5-f053-4fff-8d44-e75c4a6191ce","Type":"ContainerDied","Data":"ddd5220d288b4eac710b2a8ea4ec37bab032262f9ab3eafb683ff59666d2fd77"} Jul 16 17:20:23.523085 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.523054 2579 scope.go:117] "RemoveContainer" containerID="ddd5220d288b4eac710b2a8ea4ec37bab032262f9ab3eafb683ff59666d2fd77" Jul 16 17:20:23.524560 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.524536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd" event={"ID":"0b9376c1-6422-4886-93b3-9155ccaf7cb1","Type":"ContainerStarted","Data":"9fd651b356a43a340a8c7347fbf5838f8d1c3f1a42da820e1191e6a4d4d844aa"} Jul 16 17:20:23.526174 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.526145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz" event={"ID":"5808c6f0-e998-438e-ae9a-f0b24f69963b","Type":"ContainerStarted","Data":"44ffdd051660b081684fbac1713a7f32fc3954914e8a9c0cb4bc8da505e63357"} Jul 16 17:20:23.527558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.527538 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9sbhl" event={"ID":"7d44c547-b9b3-4cd8-984d-2141e733bd84","Type":"ContainerStarted","Data":"8bb1af20459201a6d06c563c408b6c67a2b112e3d4b21107e145e841c686c63f"} Jul 16 17:20:23.531380 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.531338 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" podStartSLOduration=29.32141095 podStartE2EDuration="36.531325163s" totalImagesPullingTime="7.209914213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:23.530416984 +0000 UTC m=+46.851633149" watchObservedRunningTime="2026-07-16 17:20:23.531325163 +0000 UTC m=+46.852541327" Jul 16 17:20:23.554489 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.554436 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kp8cv" podStartSLOduration=14.362713309 podStartE2EDuration="46.554416291s" totalImagesPullingTime="32.191702982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:23.552841523 +0000 UTC m=+46.874057707" watchObservedRunningTime="2026-07-16 17:20:23.554416291 +0000 UTC m=+46.875632457" Jul 16 17:20:23.570133 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.570082 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n4qmz" podStartSLOduration=18.593201632 podStartE2EDuration="25.570065865s" totalImagesPullingTime="6.976864233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:23.568945572 +0000 UTC m=+46.890161759" watchObservedRunningTime="2026-07-16 17:20:23.570065865 +0000 UTC m=+46.891282030" Jul 16 17:20:23.586543 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.586488 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9sbhl" podStartSLOduration=3.611058401 podStartE2EDuration="10.586474651s" totalImagesPullingTime="6.97541625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:23.586087785 +0000 UTC m=+46.907303978" watchObservedRunningTime="2026-07-16 17:20:23.586474651 +0000 UTC m=+46.907690816" Jul 16 17:20:23.639945 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.639893 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dtpvd" podStartSLOduration=29.63582379 podStartE2EDuration="36.639872275s" totalImagesPullingTime="7.004048485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:23.621873851 +0000 UTC m=+46.943090033" watchObservedRunningTime="2026-07-16 17:20:23.639872275 +0000 UTC m=+46.961088444" Jul 16 17:20:23.640087 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.639990 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" podStartSLOduration=29.663552911 podStartE2EDuration="36.639983762s" totalImagesPullingTime="6.976430851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:23.639355309 +0000 UTC m=+46.960571474" watchObservedRunningTime="2026-07-16 17:20:23.639983762 +0000 UTC m=+46.961199930" Jul 16 17:20:23.675678 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.675629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:23.777168 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.777081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:23.848570 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.848537 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:23.848719 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.848613 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:23.993586 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:23.993551 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:24.081280 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.081189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:24.170457 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.170420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:24.226368 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.226334 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:24.328143 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.328106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:24.414642 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.414602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:24.533153 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.533127 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:20:24.533523 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.533515 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/0.log" Jul 16 17:20:24.533582 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.533562 2579 generic.go:356] "Generic (PLEG): container finished" podID="a72ed6e5-f053-4fff-8d44-e75c4a6191ce" containerID="b05ea759c3b51c330aaa4a6f2b28d13e513e20296a894e78a64fa5aebed48312" exitCode=255 Jul 16 17:20:24.533653 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.533631 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sqx9h" event={"ID":"a72ed6e5-f053-4fff-8d44-e75c4a6191ce","Type":"ContainerDied","Data":"b05ea759c3b51c330aaa4a6f2b28d13e513e20296a894e78a64fa5aebed48312"} Jul 16 17:20:24.533717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.533704 2579 scope.go:117] "RemoveContainer" containerID="ddd5220d288b4eac710b2a8ea4ec37bab032262f9ab3eafb683ff59666d2fd77" Jul 16 17:20:24.534283 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.534265 2579 scope.go:117] "RemoveContainer" containerID="b05ea759c3b51c330aaa4a6f2b28d13e513e20296a894e78a64fa5aebed48312" Jul 16 17:20:24.534447 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:24.534423 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-sqx9h_openshift-console-operator(a72ed6e5-f053-4fff-8d44-e75c4a6191ce)\"" pod="openshift-console-operator/console-operator-7866497494-sqx9h" podUID="a72ed6e5-f053-4fff-8d44-e75c4a6191ce" Jul 16 17:20:24.647058 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.647021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:24.715729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.715638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:24.861435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.861396 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xznv2"] Jul 16 17:20:24.891769 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.891738 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xznv2"] Jul 16 17:20:24.891925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.891859 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:24.894910 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.894887 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 16 17:20:24.895051 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.894991 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wdcm7\"" Jul 16 17:20:24.895917 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.895885 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 16 17:20:24.921702 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.921670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/603a7915-9507-47fd-af9c-5bb6670da635-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:24.921885 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.921807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:24.948249 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:24.948211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:25.022965 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.022884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:25.023105 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.023005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/603a7915-9507-47fd-af9c-5bb6670da635-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:25.023105 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:25.023015 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 17:20:25.023105 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:25.023081 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert podName:603a7915-9507-47fd-af9c-5bb6670da635 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:25.523060856 +0000 UTC m=+48.844276997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xznv2" (UID: "603a7915-9507-47fd-af9c-5bb6670da635") : secret "networking-console-plugin-cert" not found Jul 16 17:20:25.023658 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.023640 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/603a7915-9507-47fd-af9c-5bb6670da635-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:25.086426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.086382 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:25.100016 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.099981 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p"] Jul 16 17:20:25.117569 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.117541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p"] Jul 16 17:20:25.117734 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.117682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" Jul 16 17:20:25.120079 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.120057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 17:20:25.120447 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.120430 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 17:20:25.120563 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.120518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-295ws\"" Jul 16 17:20:25.180201 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.180163 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:25.223939 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.223910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z45bj\" (UniqueName: \"kubernetes.io/projected/fba80834-4340-43f2-8ede-ac015983c87f-kube-api-access-z45bj\") pod \"migrator-7f59b54f6c-vlp2p\" (UID: \"fba80834-4340-43f2-8ede-ac015983c87f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" Jul 16 17:20:25.297659 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.297560 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:25.325320 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.325284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z45bj\" (UniqueName: \"kubernetes.io/projected/fba80834-4340-43f2-8ede-ac015983c87f-kube-api-access-z45bj\") pod \"migrator-7f59b54f6c-vlp2p\" (UID: \"fba80834-4340-43f2-8ede-ac015983c87f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" Jul 16 17:20:25.336675 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.336650 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z45bj\" (UniqueName: \"kubernetes.io/projected/fba80834-4340-43f2-8ede-ac015983c87f-kube-api-access-z45bj\") pod \"migrator-7f59b54f6c-vlp2p\" (UID: \"fba80834-4340-43f2-8ede-ac015983c87f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" Jul 16 17:20:25.426738 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.426697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" Jul 16 17:20:25.527434 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.527402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:25.527578 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:25.527558 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 17:20:25.527645 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:25.527632 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert podName:603a7915-9507-47fd-af9c-5bb6670da635 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:26.527613041 +0000 UTC m=+49.848829185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xznv2" (UID: "603a7915-9507-47fd-af9c-5bb6670da635") : secret "networking-console-plugin-cert" not found Jul 16 17:20:25.539483 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.539459 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:20:25.541588 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.541571 2579 scope.go:117] "RemoveContainer" containerID="b05ea759c3b51c330aaa4a6f2b28d13e513e20296a894e78a64fa5aebed48312" Jul 16 17:20:25.541935 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:25.541910 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-sqx9h_openshift-console-operator(a72ed6e5-f053-4fff-8d44-e75c4a6191ce)\"" pod="openshift-console-operator/console-operator-7866497494-sqx9h" podUID="a72ed6e5-f053-4fff-8d44-e75c4a6191ce" Jul 16 17:20:25.574475 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.574379 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p"] Jul 16 17:20:25.578312 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:25.578286 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba80834_4340_43f2_8ede_ac015983c87f.slice/crio-7faf7c3461d97179628beebc207b32cbeb3212ff2b1bb7471e097f03982dab2a WatchSource:0}: Error finding container 7faf7c3461d97179628beebc207b32cbeb3212ff2b1bb7471e097f03982dab2a: Status 404 returned error can't find the container with id 7faf7c3461d97179628beebc207b32cbeb3212ff2b1bb7471e097f03982dab2a Jul 16 17:20:25.827710 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.827615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:25.905345 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:25.905301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:26.225503 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.225464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:26.524280 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.524195 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8ldlk"] Jul 16 17:20:26.537255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.537228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:26.537434 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:26.537414 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 17:20:26.537503 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:26.537491 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert podName:603a7915-9507-47fd-af9c-5bb6670da635 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:28.537470106 +0000 UTC m=+51.858686260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xznv2" (UID: "603a7915-9507-47fd-af9c-5bb6670da635") : secret "networking-console-plugin-cert" not found Jul 16 17:20:26.564105 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.564067 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8ldlk"] Jul 16 17:20:26.564105 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.564109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" event={"ID":"fba80834-4340-43f2-8ede-ac015983c87f","Type":"ContainerStarted","Data":"7faf7c3461d97179628beebc207b32cbeb3212ff2b1bb7471e097f03982dab2a"} Jul 16 17:20:26.564583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.564184 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.566594 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.566575 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 16 17:20:26.567215 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.567184 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 16 17:20:26.567215 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.567197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-r4j29\"" Jul 16 17:20:26.567215 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.567201 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 16 17:20:26.567422 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.567240 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 16 17:20:26.638398 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.638359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59v6z\" (UniqueName: \"kubernetes.io/projected/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-kube-api-access-59v6z\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.638573 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.638439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-signing-key\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.638573 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.638500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-signing-cabundle\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.739447 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.739403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59v6z\" (UniqueName: \"kubernetes.io/projected/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-kube-api-access-59v6z\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.739640 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.739504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-signing-key\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.739640 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.739584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-signing-cabundle\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.740217 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.740192 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-signing-cabundle\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.741898 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.741876 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-signing-key\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.748032 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.748008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59v6z\" (UniqueName: \"kubernetes.io/projected/61501f3f-b7a3-441d-b28f-35d0bd85fbaf-kube-api-access-59v6z\") pod \"service-ca-79f68b9f4f-8ldlk\" (UID: \"61501f3f-b7a3-441d-b28f-35d0bd85fbaf\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.798950 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.798857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:26.873614 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.873581 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" Jul 16 17:20:26.904224 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:26.904023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:27.021044 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:27.021014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8ldlk"] Jul 16 17:20:27.024468 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:27.024438 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61501f3f_b7a3_441d_b28f_35d0bd85fbaf.slice/crio-18f1016a6a5a4cba7e8f0440b1ee63fa897ade7aa393481e22058dee817b22ed WatchSource:0}: Error finding container 18f1016a6a5a4cba7e8f0440b1ee63fa897ade7aa393481e22058dee817b22ed: Status 404 returned error can't find the container with id 18f1016a6a5a4cba7e8f0440b1ee63fa897ade7aa393481e22058dee817b22ed Jul 16 17:20:27.258253 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:27.258219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:27.551089 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:27.551044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" event={"ID":"61501f3f-b7a3-441d-b28f-35d0bd85fbaf","Type":"ContainerStarted","Data":"3c52834c239ba1f0f2ed519ccb3e71e370d51e6d5089ae0c30f88eb1e204a2ee"} Jul 16 17:20:27.551296 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:27.551151 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" event={"ID":"61501f3f-b7a3-441d-b28f-35d0bd85fbaf","Type":"ContainerStarted","Data":"18f1016a6a5a4cba7e8f0440b1ee63fa897ade7aa393481e22058dee817b22ed"} Jul 16 17:20:27.568487 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:27.568427 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-8ldlk" podStartSLOduration=1.568409113 podStartE2EDuration="1.568409113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:27.567831613 +0000 UTC m=+50.889047789" watchObservedRunningTime="2026-07-16 17:20:27.568409113 +0000 UTC m=+50.889625281" Jul 16 17:20:28.556526 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:28.556483 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" event={"ID":"fba80834-4340-43f2-8ede-ac015983c87f","Type":"ContainerStarted","Data":"0b68aea2804633a280f4fbff951ec045170d8cc68933d2b67dff09f799975373"} Jul 16 17:20:28.556694 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:28.556553 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" event={"ID":"fba80834-4340-43f2-8ede-ac015983c87f","Type":"ContainerStarted","Data":"6dfb221e222d6239237ba285c2368cd1dc2b40359c1c51c091fc44cad2cd22b1"} Jul 16 17:20:28.559217 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:28.559189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:28.559333 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:28.559317 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 17:20:28.559386 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:28.559376 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert podName:603a7915-9507-47fd-af9c-5bb6670da635 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:32.559361885 +0000 UTC m=+55.880578028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xznv2" (UID: "603a7915-9507-47fd-af9c-5bb6670da635") : secret "networking-console-plugin-cert" not found Jul 16 17:20:28.571200 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:28.571150 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlp2p" podStartSLOduration=1.216360872 podStartE2EDuration="3.571133518s" totalImagesPullingTime="2.354772646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:28.56980683 +0000 UTC m=+51.891023005" watchObservedRunningTime="2026-07-16 17:20:28.571133518 +0000 UTC m=+51.892349705" Jul 16 17:20:29.466418 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.466382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:29.466639 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.466451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:29.466639 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.466514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:29.466639 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.466578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:29.466639 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.466604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:29.466639 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.466636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:29.466936 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.466662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:29.466936 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.466860 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:29.466936 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.466877 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6544cd8c58-2wghd: secret "image-registry-tls" not found Jul 16 17:20:29.466936 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.466935 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls podName:860255e6-bcd3-4840-b625-f3f4f6af2502 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:45.466916227 +0000 UTC m=+68.788132384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls") pod "image-registry-6544cd8c58-2wghd" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502") : secret "image-registry-tls" not found Jul 16 17:20:29.467153 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467009 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 17:20:29.467153 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467020 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57df49f845-vg9nj: secret "image-registry-tls" not found Jul 16 17:20:29.467153 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467052 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls podName:de0d20d5-de0d-4c23-b1c1-01d77d940101 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:45.467041386 +0000 UTC m=+68.788257542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls") pod "image-registry-57df49f845-vg9nj" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101") : secret "image-registry-tls" not found Jul 16 17:20:29.467153 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467113 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 17:20:29.467153 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467146 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:45.467135365 +0000 UTC m=+68.788351522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : secret "router-metrics-certs-default" not found Jul 16 17:20:29.467435 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467211 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle podName:15b2c949-fa93-4a22-bb20-bdf8c250d20a nodeName:}" failed. No retries permitted until 2026-07-16 17:20:45.467200842 +0000 UTC m=+68.788416998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle") pod "router-default-6b7bc4f64d-dt8h4" (UID: "15b2c949-fa93-4a22-bb20-bdf8c250d20a") : configmap references non-existent config key: service-ca.crt Jul 16 17:20:29.467435 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467267 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:29.467435 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467298 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls podName:16fadc42-e835-45ea-b1e3-9cd4656a73c8 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:45.467287799 +0000 UTC m=+68.788503943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9ffkm" (UID: "16fadc42-e835-45ea-b1e3-9cd4656a73c8") : secret "cluster-monitoring-operator-tls" not found Jul 16 17:20:29.467435 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467357 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 17:20:29.467435 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467390 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls podName:90c8c6f6-8377-4672-8217-756ba6aaf696 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:45.467378347 +0000 UTC m=+68.788594503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls") pod "cluster-samples-operator-65db858894-6qhmt" (UID: "90c8c6f6-8377-4672-8217-756ba6aaf696") : secret "samples-operator-tls" not found Jul 16 17:20:29.467684 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467443 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 17:20:29.467684 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:29.467473 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls podName:0c0a9fe5-b012-46d4-9f21-e5a3a8592f19 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:45.467463 +0000 UTC m=+68.788679146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls") pod "dns-default-f964c" (UID: "0c0a9fe5-b012-46d4-9f21-e5a3a8592f19") : secret "dns-default-metrics-tls" not found Jul 16 17:20:29.501637 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.501600 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:29.607370 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.607332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:29.710024 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.709985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:29.803617 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.803522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:29.866172 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:29.866138 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:30.397052 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:30.397015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:30.510154 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:30.510120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:30.998048 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:30.998015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:32.599231 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:32.599192 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:32.599715 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:32.599363 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 17:20:32.599715 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:20:32.599467 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert podName:603a7915-9507-47fd-af9c-5bb6670da635 nodeName:}" failed. No retries permitted until 2026-07-16 17:20:40.599447354 +0000 UTC m=+63.920663499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xznv2" (UID: "603a7915-9507-47fd-af9c-5bb6670da635") : secret "networking-console-plugin-cert" not found Jul 16 17:20:32.702435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:32.702400 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:32.762628 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:32.762593 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:32.816309 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:32.816276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:32.998588 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:32.998553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:33.200066 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:33.200029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:33.306094 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:33.306010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:33.421059 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:33.421020 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:33.840244 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:33.840210 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:33.849082 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:33.849059 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:33.849159 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:33.849109 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:33.849452 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:33.849439 2579 scope.go:117] "RemoveContainer" containerID="b05ea759c3b51c330aaa4a6f2b28d13e513e20296a894e78a64fa5aebed48312" Jul 16 17:20:33.970741 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:33.970693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:34.204874 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:34.204838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:34.579506 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:34.579432 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:20:34.579648 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:34.579514 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sqx9h" event={"ID":"a72ed6e5-f053-4fff-8d44-e75c4a6191ce","Type":"ContainerStarted","Data":"a0e84a89eed55fcb94119a137c4bcd60ab1709e0d48a34d745c09e78abcb9bfc"} Jul 16 17:20:34.579845 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:34.579803 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:34.595873 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:34.595809 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-sqx9h" podStartSLOduration=40.393131056 podStartE2EDuration="47.595793656s" totalImagesPullingTime="7.2026626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:34.595054578 +0000 UTC m=+57.916270743" watchObservedRunningTime="2026-07-16 17:20:34.595793656 +0000 UTC m=+57.917009798" Jul 16 17:20:34.600796 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:34.600768 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:34.996630 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:34.996585 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:35.130183 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:35.130156 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-sqx9h" Jul 16 17:20:35.309578 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:35.309489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:35.410962 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:35.410930 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:35.708575 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:35.708543 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:37.047764 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:37.047722 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:37.101565 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:37.101527 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:37.200199 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:37.200162 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:37.394572 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:37.394535 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:37.798048 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:37.797955 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:37.996797 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:37.996747 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:38.419667 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:38.419609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:38.519995 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:38.519959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:38.621878 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:38.621833 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:38.811578 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:38.811487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:39.419420 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:39.419384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:39.469738 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:39.469715 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zz6jt" Jul 16 17:20:39.801279 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:39.801191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:40.592182 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:40.592131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:40.672100 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:40.672061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:40.675065 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:40.675045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:40.677488 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:40.677459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/603a7915-9507-47fd-af9c-5bb6670da635-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xznv2\" (UID: \"603a7915-9507-47fd-af9c-5bb6670da635\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:40.805306 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:40.805275 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wdcm7\"" Jul 16 17:20:40.813943 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:40.813922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" Jul 16 17:20:40.937610 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:40.937583 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xznv2"] Jul 16 17:20:40.940056 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:40.940029 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603a7915_9507_47fd_af9c_5bb6670da635.slice/crio-8032da564629f6e19c3d9826f7c605148cc5a962a19e2c039cd4488cd13af57e WatchSource:0}: Error finding container 8032da564629f6e19c3d9826f7c605148cc5a962a19e2c039cd4488cd13af57e: Status 404 returned error can't find the container with id 8032da564629f6e19c3d9826f7c605148cc5a962a19e2c039cd4488cd13af57e Jul 16 17:20:41.604197 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:41.604157 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" event={"ID":"603a7915-9507-47fd-af9c-5bb6670da635","Type":"ContainerStarted","Data":"8032da564629f6e19c3d9826f7c605148cc5a962a19e2c039cd4488cd13af57e"} Jul 16 17:20:42.609386 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:42.609299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" event={"ID":"603a7915-9507-47fd-af9c-5bb6670da635","Type":"ContainerStarted","Data":"bdec5df4d431702d82acb75da2a42281f70bab593afbc468c925bf705a4fca9b"} Jul 16 17:20:42.624267 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:42.624213 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-xznv2" podStartSLOduration=17.398972384 podStartE2EDuration="18.624198487s" totalImagesPullingTime="1.225226103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:42.62275765 +0000 UTC m=+65.943973824" watchObservedRunningTime="2026-07-16 17:20:42.624198487 +0000 UTC m=+65.945414709" Jul 16 17:20:42.897132 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:42.897096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:42.899551 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:42.899527 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 17:20:42.910290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:42.910264 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28b93950-4c7e-428e-bf79-aa152be2cee6-metrics-certs\") pod \"network-metrics-daemon-pd47t\" (UID: \"28b93950-4c7e-428e-bf79-aa152be2cee6\") " pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:42.998425 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:42.998386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:42.998619 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:42.998513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:43.001033 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.001000 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95djt\" (UniqueName: \"kubernetes.io/projected/60f67669-e12d-4d64-9eda-478688b83664-kube-api-access-95djt\") pod \"network-check-target-898mx\" (UID: \"60f67669-e12d-4d64-9eda-478688b83664\") " pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:43.001142 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.001103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 17:20:43.010682 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.010661 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0823601-1c1f-4a81-9212-3ef17f75c8e3-original-pull-secret\") pod \"global-pull-secret-syncer-xjcjr\" (UID: \"a0823601-1c1f-4a81-9212-3ef17f75c8e3\") " pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:43.124986 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.124941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xjcjr" Jul 16 17:20:43.135033 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.135011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-grt9w\"" Jul 16 17:20:43.141965 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.141940 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vnxgq\"" Jul 16 17:20:43.142957 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.142941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:43.151414 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.151356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd47t" Jul 16 17:20:43.278033 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.277645 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xjcjr"] Jul 16 17:20:43.278388 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:43.278362 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0823601_1c1f_4a81_9212_3ef17f75c8e3.slice/crio-2d60fbeb29abc6b537eb1e62333e4f58cd4b84cf9c84859d622cbef0c082687e WatchSource:0}: Error finding container 2d60fbeb29abc6b537eb1e62333e4f58cd4b84cf9c84859d622cbef0c082687e: Status 404 returned error can't find the container with id 2d60fbeb29abc6b537eb1e62333e4f58cd4b84cf9c84859d622cbef0c082687e Jul 16 17:20:43.291149 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.291123 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-898mx"] Jul 16 17:20:43.293425 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:43.293401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f67669_e12d_4d64_9eda_478688b83664.slice/crio-2c8a59eb8240a793d586e9cd4ae23b79df1411afa36e8f40f29b68015bf480f9 WatchSource:0}: Error finding container 2c8a59eb8240a793d586e9cd4ae23b79df1411afa36e8f40f29b68015bf480f9: Status 404 returned error can't find the container with id 2c8a59eb8240a793d586e9cd4ae23b79df1411afa36e8f40f29b68015bf480f9 Jul 16 17:20:43.309729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.309705 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pd47t"] Jul 16 17:20:43.312323 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:43.312290 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b93950_4c7e_428e_bf79_aa152be2cee6.slice/crio-cb3fca0ff16b6c432ebf6d435e41d54ee2ccce618813717e538fedb769b50570 WatchSource:0}: Error finding container cb3fca0ff16b6c432ebf6d435e41d54ee2ccce618813717e538fedb769b50570: Status 404 returned error can't find the container with id cb3fca0ff16b6c432ebf6d435e41d54ee2ccce618813717e538fedb769b50570 Jul 16 17:20:43.613555 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.613524 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd47t" event={"ID":"28b93950-4c7e-428e-bf79-aa152be2cee6","Type":"ContainerStarted","Data":"cb3fca0ff16b6c432ebf6d435e41d54ee2ccce618813717e538fedb769b50570"} Jul 16 17:20:43.614930 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.614907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-898mx" event={"ID":"60f67669-e12d-4d64-9eda-478688b83664","Type":"ContainerStarted","Data":"245c5c64f628da69dde5cd1de5d6ffe033321f7314e53b3ecb297bb16ce87bb3"} Jul 16 17:20:43.615077 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.614944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-898mx" event={"ID":"60f67669-e12d-4d64-9eda-478688b83664","Type":"ContainerStarted","Data":"2c8a59eb8240a793d586e9cd4ae23b79df1411afa36e8f40f29b68015bf480f9"} Jul 16 17:20:43.615077 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.615052 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:20:43.616008 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.615989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xjcjr" event={"ID":"a0823601-1c1f-4a81-9212-3ef17f75c8e3","Type":"ContainerStarted","Data":"2d60fbeb29abc6b537eb1e62333e4f58cd4b84cf9c84859d622cbef0c082687e"} Jul 16 17:20:43.630157 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:43.630108 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-898mx" podStartSLOduration=66.630096011 podStartE2EDuration="1m6.630096011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:43.629687055 +0000 UTC m=+66.950903219" watchObservedRunningTime="2026-07-16 17:20:43.630096011 +0000 UTC m=+66.951312174" Jul 16 17:20:45.523255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.523211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:45.523255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.523275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:45.523804 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.523321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:45.523804 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.523370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:45.523804 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.523399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:45.523804 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.523431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:45.523804 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.523449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:45.524141 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.524114 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b2c949-fa93-4a22-bb20-bdf8c250d20a-service-ca-bundle\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:45.526598 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.526562 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/90c8c6f6-8377-4672-8217-756ba6aaf696-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6qhmt\" (UID: \"90c8c6f6-8377-4672-8217-756ba6aaf696\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:45.526598 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.526590 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"image-registry-6544cd8c58-2wghd\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:45.526853 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.526591 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"image-registry-57df49f845-vg9nj\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:45.527244 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.527160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c0a9fe5-b012-46d4-9f21-e5a3a8592f19-metrics-tls\") pod \"dns-default-f964c\" (UID: \"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19\") " pod="openshift-dns/dns-default-f964c" Jul 16 17:20:45.527338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.527312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16fadc42-e835-45ea-b1e3-9cd4656a73c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9ffkm\" (UID: \"16fadc42-e835-45ea-b1e3-9cd4656a73c8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:45.528109 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.528046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15b2c949-fa93-4a22-bb20-bdf8c250d20a-metrics-certs\") pod \"router-default-6b7bc4f64d-dt8h4\" (UID: \"15b2c949-fa93-4a22-bb20-bdf8c250d20a\") " pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:45.679689 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.679653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5x6n8\"" Jul 16 17:20:45.687498 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.687435 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:45.689477 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.689437 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2m82d\"" Jul 16 17:20:45.697953 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.697929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" Jul 16 17:20:45.703044 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.703017 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jj8sq\"" Jul 16 17:20:45.709353 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.709326 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-89d6z\"" Jul 16 17:20:45.711904 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.711855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" Jul 16 17:20:45.718094 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.718022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:45.723239 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.723215 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:45.737717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.737649 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sjk2m\"" Jul 16 17:20:45.745644 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.745611 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f964c" Jul 16 17:20:45.896972 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.896885 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b7bc4f64d-dt8h4"] Jul 16 17:20:45.923871 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.922767 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm"] Jul 16 17:20:45.953965 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.953925 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57df49f845-vg9nj"] Jul 16 17:20:45.978932 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:45.978899 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt"] Jul 16 17:20:46.216405 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:46.216366 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fadc42_e835_45ea_b1e3_9cd4656a73c8.slice/crio-11b42703d3a06303014601ca3bee526e2e88cf626dab1538ee632d7fd119fc16 WatchSource:0}: Error finding container 11b42703d3a06303014601ca3bee526e2e88cf626dab1538ee632d7fd119fc16: Status 404 returned error can't find the container with id 11b42703d3a06303014601ca3bee526e2e88cf626dab1538ee632d7fd119fc16 Jul 16 17:20:46.217884 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:46.217833 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b2c949_fa93_4a22_bb20_bdf8c250d20a.slice/crio-dc3e670724185c6e662344bd8b3aeb9122d462eb3ce35299418189a7d5891ff4 WatchSource:0}: Error finding container dc3e670724185c6e662344bd8b3aeb9122d462eb3ce35299418189a7d5891ff4: Status 404 returned error can't find the container with id dc3e670724185c6e662344bd8b3aeb9122d462eb3ce35299418189a7d5891ff4 Jul 16 17:20:46.220880 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:46.220188 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde0d20d5_de0d_4c23_b1c1_01d77d940101.slice/crio-cba830fb69526200c6138db3deadec5202c356cca0c80bb066f686be8cc9a848 WatchSource:0}: Error finding container cba830fb69526200c6138db3deadec5202c356cca0c80bb066f686be8cc9a848: Status 404 returned error can't find the container with id cba830fb69526200c6138db3deadec5202c356cca0c80bb066f686be8cc9a848 Jul 16 17:20:46.396508 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.396442 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f964c"] Jul 16 17:20:46.399561 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:46.399525 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0a9fe5_b012_46d4_9f21_e5a3a8592f19.slice/crio-bb1f525db5945eb51c207d9eebd6e15c20c8b4837733bbfa74e6d468a1bd6726 WatchSource:0}: Error finding container bb1f525db5945eb51c207d9eebd6e15c20c8b4837733bbfa74e6d468a1bd6726: Status 404 returned error can't find the container with id bb1f525db5945eb51c207d9eebd6e15c20c8b4837733bbfa74e6d468a1bd6726 Jul 16 17:20:46.424141 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.424107 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6544cd8c58-2wghd"] Jul 16 17:20:46.428534 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:46.428482 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860255e6_bcd3_4840_b625_f3f4f6af2502.slice/crio-2a15f1c38a42e56ccd4237b9b0d42ac3229507be17e0fbc67229353d40c1887a WatchSource:0}: Error finding container 2a15f1c38a42e56ccd4237b9b0d42ac3229507be17e0fbc67229353d40c1887a: Status 404 returned error can't find the container with id 2a15f1c38a42e56ccd4237b9b0d42ac3229507be17e0fbc67229353d40c1887a Jul 16 17:20:46.488893 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.488806 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8p5rc"] Jul 16 17:20:46.499913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.499882 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7"] Jul 16 17:20:46.500067 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.500005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.502392 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.502362 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 17:20:46.502392 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.502400 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pqqgw\"" Jul 16 17:20:46.502715 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.502699 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 17:20:46.503249 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.503072 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 17:20:46.503928 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.503895 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 17:20:46.509463 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.509413 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 17:20:46.510344 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.510299 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8"] Jul 16 17:20:46.512058 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.511339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.514442 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.514421 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 17:20:46.514944 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.514925 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 17:20:46.515396 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.515379 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 17:20:46.515699 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.515576 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 17:20:46.525122 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.525099 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b"] Jul 16 17:20:46.525485 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.525247 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" Jul 16 17:20:46.528706 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.528679 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jgq75\"" Jul 16 17:20:46.532275 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.531646 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 17:20:46.551431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.551041 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8p5rc"] Jul 16 17:20:46.551431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.551091 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57df49f845-vg9nj"] Jul 16 17:20:46.551431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.551120 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7"] Jul 16 17:20:46.551431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.551142 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8"] Jul 16 17:20:46.551431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.551158 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b"] Jul 16 17:20:46.551846 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.551446 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.553454 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.553410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 16 17:20:46.553697 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.553648 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 16 17:20:46.553925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.553904 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 16 17:20:46.554213 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.554192 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 16 17:20:46.590285 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.590175 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-q2nxz"] Jul 16 17:20:46.599013 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.598982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:46.602731 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.602707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-q2nxz" Jul 16 17:20:46.605887 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.605863 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-q2nxz"] Jul 16 17:20:46.606418 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.606396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-thjxl\"" Jul 16 17:20:46.606862 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.606845 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 17:20:46.608158 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.608138 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 17:20:46.634054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.633783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-snapshots\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.634054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.633902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b051f5a2-0c02-4163-81e8-e3b40899829c-tmp\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.634054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.633944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b051f5a2-0c02-4163-81e8-e3b40899829c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.634054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.633975 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-tmp\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.634054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.634025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t7bq\" (UniqueName: \"kubernetes.io/projected/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-kube-api-access-9t7bq\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.634426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.634091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.634426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.634115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.634426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.634141 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-serving-cert\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.634426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.634169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99ngw\" (UniqueName: \"kubernetes.io/projected/b051f5a2-0c02-4163-81e8-e3b40899829c-kube-api-access-99ngw\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.634426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.634195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c686\" (UniqueName: \"kubernetes.io/projected/2d9dd9f3-655c-449c-b2eb-2b666d4a7091-kube-api-access-6c686\") pod \"managed-serviceaccount-addon-agent-7fb7946d9b-w57n8\" (UID: \"2d9dd9f3-655c-449c-b2eb-2b666d4a7091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" Jul 16 17:20:46.634426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.634252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d9dd9f3-655c-449c-b2eb-2b666d4a7091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7946d9b-w57n8\" (UID: \"2d9dd9f3-655c-449c-b2eb-2b666d4a7091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" Jul 16 17:20:46.636073 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.636020 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" event={"ID":"16fadc42-e835-45ea-b1e3-9cd4656a73c8","Type":"ContainerStarted","Data":"11b42703d3a06303014601ca3bee526e2e88cf626dab1538ee632d7fd119fc16"} Jul 16 17:20:46.638426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.638398 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" event={"ID":"860255e6-bcd3-4840-b625-f3f4f6af2502","Type":"ContainerStarted","Data":"2a15f1c38a42e56ccd4237b9b0d42ac3229507be17e0fbc67229353d40c1887a"} Jul 16 17:20:46.640484 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.640459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f964c" event={"ID":"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19","Type":"ContainerStarted","Data":"bb1f525db5945eb51c207d9eebd6e15c20c8b4837733bbfa74e6d468a1bd6726"} Jul 16 17:20:46.644900 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.644871 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" event={"ID":"15b2c949-fa93-4a22-bb20-bdf8c250d20a","Type":"ContainerStarted","Data":"8d497646acb515aeeaf14d59cc07e5b138eab97cc436b32818cbb9dfa0cc8922"} Jul 16 17:20:46.645083 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.645057 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" event={"ID":"15b2c949-fa93-4a22-bb20-bdf8c250d20a","Type":"ContainerStarted","Data":"dc3e670724185c6e662344bd8b3aeb9122d462eb3ce35299418189a7d5891ff4"} Jul 16 17:20:46.650269 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.649286 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" event={"ID":"90c8c6f6-8377-4672-8217-756ba6aaf696","Type":"ContainerStarted","Data":"aec0406b0db903327ddea96bf4bb710cc2070c2faa6aab3109cd9183a3ccae7b"} Jul 16 17:20:46.651134 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.651107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" event={"ID":"de0d20d5-de0d-4c23-b1c1-01d77d940101","Type":"ContainerStarted","Data":"82ea5bf2329ac6d8cc197ef64f6e24104799f3acd1b70e0d0c6da40bacd157c6"} Jul 16 17:20:46.651233 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.651150 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" event={"ID":"de0d20d5-de0d-4c23-b1c1-01d77d940101","Type":"ContainerStarted","Data":"cba830fb69526200c6138db3deadec5202c356cca0c80bb066f686be8cc9a848"} Jul 16 17:20:46.651493 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.651472 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:20:46.683911 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.683871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:46.687913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.687841 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:46.690442 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.690423 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:46.697462 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.697397 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" podStartSLOduration=34.697377992 podStartE2EDuration="34.697377992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:46.696196084 +0000 UTC m=+70.017412317" watchObservedRunningTime="2026-07-16 17:20:46.697377992 +0000 UTC m=+70.018594150" Jul 16 17:20:46.698569 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.698513 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" podStartSLOduration=69.698497001 podStartE2EDuration="1m9.698497001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:46.671698703 +0000 UTC m=+69.992914867" watchObservedRunningTime="2026-07-16 17:20:46.698497001 +0000 UTC m=+70.019713166" Jul 16 17:20:46.735459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t7bq\" (UniqueName: \"kubernetes.io/projected/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-kube-api-access-9t7bq\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.735459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.735459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xvpq\" (UniqueName: \"kubernetes.io/projected/7b4ff353-2dcc-4389-a52d-6ae246bb386f-kube-api-access-6xvpq\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.735459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b4ff353-2dcc-4389-a52d-6ae246bb386f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.735459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.735459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.735459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-ca\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.735459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-serving-cert\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99ngw\" (UniqueName: \"kubernetes.io/projected/b051f5a2-0c02-4163-81e8-e3b40899829c-kube-api-access-99ngw\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.735964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c686\" (UniqueName: \"kubernetes.io/projected/2d9dd9f3-655c-449c-b2eb-2b666d4a7091-kube-api-access-6c686\") pod \"managed-serviceaccount-addon-agent-7fb7946d9b-w57n8\" (UID: \"2d9dd9f3-655c-449c-b2eb-2b666d4a7091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj58m\" (UniqueName: \"kubernetes.io/projected/c5732757-e4db-4cf5-a4a4-0d94791abda4-kube-api-access-cj58m\") pod \"downloads-68c9cbb497-q2nxz\" (UID: \"c5732757-e4db-4cf5-a4a4-0d94791abda4\") " pod="openshift-console/downloads-68c9cbb497-q2nxz" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d9dd9f3-655c-449c-b2eb-2b666d4a7091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7946d9b-w57n8\" (UID: \"2d9dd9f3-655c-449c-b2eb-2b666d4a7091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-snapshots\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b051f5a2-0c02-4163-81e8-e3b40899829c-tmp\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b051f5a2-0c02-4163-81e8-e3b40899829c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-tmp\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-hub\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.736790 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.737045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.738305 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.737330 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-tmp\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.739924 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.739338 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-snapshots\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.740078 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.739928 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b051f5a2-0c02-4163-81e8-e3b40899829c-tmp\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.740556 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.740509 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b051f5a2-0c02-4163-81e8-e3b40899829c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.741201 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.741176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d9dd9f3-655c-449c-b2eb-2b666d4a7091-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7946d9b-w57n8\" (UID: \"2d9dd9f3-655c-449c-b2eb-2b666d4a7091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" Jul 16 17:20:46.742731 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.742669 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-serving-cert\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.759412 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.759375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99ngw\" (UniqueName: \"kubernetes.io/projected/b051f5a2-0c02-4163-81e8-e3b40899829c-kube-api-access-99ngw\") pod \"klusterlet-addon-workmgr-6bb5f84c7c-5vgw7\" (UID: \"b051f5a2-0c02-4163-81e8-e3b40899829c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.760027 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.760006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t7bq\" (UniqueName: \"kubernetes.io/projected/5fec9a68-0ff8-4d95-ab71-ab7a136504f0-kube-api-access-9t7bq\") pod \"insights-operator-68d9dd94cf-8p5rc\" (UID: \"5fec9a68-0ff8-4d95-ab71-ab7a136504f0\") " pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.769414 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.769387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c686\" (UniqueName: \"kubernetes.io/projected/2d9dd9f3-655c-449c-b2eb-2b666d4a7091-kube-api-access-6c686\") pod \"managed-serviceaccount-addon-agent-7fb7946d9b-w57n8\" (UID: \"2d9dd9f3-655c-449c-b2eb-2b666d4a7091\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" Jul 16 17:20:46.812185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.812153 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" Jul 16 17:20:46.825768 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.825578 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:20:46.830689 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.830660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:46.837705 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.837681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b4ff353-2dcc-4389-a52d-6ae246bb386f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.837880 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.837731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-ca\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.837880 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.837808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj58m\" (UniqueName: \"kubernetes.io/projected/c5732757-e4db-4cf5-a4a4-0d94791abda4-kube-api-access-cj58m\") pod \"downloads-68c9cbb497-q2nxz\" (UID: \"c5732757-e4db-4cf5-a4a4-0d94791abda4\") " pod="openshift-console/downloads-68c9cbb497-q2nxz" Jul 16 17:20:46.838020 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.837954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.838020 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.837985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-hub\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.838127 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.838049 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.838127 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.838122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xvpq\" (UniqueName: \"kubernetes.io/projected/7b4ff353-2dcc-4389-a52d-6ae246bb386f-kube-api-access-6xvpq\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.840271 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.839470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b4ff353-2dcc-4389-a52d-6ae246bb386f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.843352 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.843307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.843496 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.843462 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-ca\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.843555 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.843502 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.845042 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.845021 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b4ff353-2dcc-4389-a52d-6ae246bb386f-hub\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.865197 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.865126 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj58m\" (UniqueName: \"kubernetes.io/projected/c5732757-e4db-4cf5-a4a4-0d94791abda4-kube-api-access-cj58m\") pod \"downloads-68c9cbb497-q2nxz\" (UID: \"c5732757-e4db-4cf5-a4a4-0d94791abda4\") " pod="openshift-console/downloads-68c9cbb497-q2nxz" Jul 16 17:20:46.866673 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.866603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xvpq\" (UniqueName: \"kubernetes.io/projected/7b4ff353-2dcc-4389-a52d-6ae246bb386f-kube-api-access-6xvpq\") pod \"cluster-proxy-proxy-agent-77664c5759-tbw2b\" (UID: \"7b4ff353-2dcc-4389-a52d-6ae246bb386f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.874089 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.874060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" Jul 16 17:20:46.882486 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.882392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" Jul 16 17:20:46.946885 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.946745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:46.947648 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:46.947209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-q2nxz" Jul 16 17:20:47.025476 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.025386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.071607 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.071332 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56cd676545-wgzw8"] Jul 16 17:20:47.075029 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.074979 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.082893 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.079314 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2bqjs\"" Jul 16 17:20:47.082893 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.079414 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 17:20:47.082893 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.079451 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 17:20:47.082893 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.079677 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 17:20:47.082893 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.080080 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 17:20:47.082893 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.080125 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 17:20:47.089516 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.089486 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cd676545-wgzw8"] Jul 16 17:20:47.110074 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.110008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.194590 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.194382 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.241273 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.241215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-console-config\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.241273 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.241260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8d5f\" (UniqueName: \"kubernetes.io/projected/62e63f6a-105a-401d-a50b-aafd1457189e-kube-api-access-l8d5f\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.241514 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.241345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-oauth-serving-cert\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.241514 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.241389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-oauth-config\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.241514 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.241457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-service-ca\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.241661 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.241520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-serving-cert\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.294902 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.294668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.342010 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.341976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-oauth-serving-cert\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.342250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.342035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-oauth-config\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.342250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.342063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-service-ca\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.342250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.342094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-serving-cert\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.342250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.342167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-console-config\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.342250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.342199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8d5f\" (UniqueName: \"kubernetes.io/projected/62e63f6a-105a-401d-a50b-aafd1457189e-kube-api-access-l8d5f\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.343609 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.343236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-service-ca\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.343609 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.343544 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-oauth-serving-cert\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.344195 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.344136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-console-config\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.346202 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.346157 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-serving-cert\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.346202 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.346191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-oauth-config\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.351062 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.351012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8d5f\" (UniqueName: \"kubernetes.io/projected/62e63f6a-105a-401d-a50b-aafd1457189e-kube-api-access-l8d5f\") pod \"console-56cd676545-wgzw8\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.362110 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.362010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.396735 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.396502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:20:47.449620 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.449525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.548670 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.548522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.647783 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.647739 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.656839 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.656792 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" event={"ID":"860255e6-bcd3-4840-b625-f3f4f6af2502","Type":"ContainerStarted","Data":"ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d"} Jul 16 17:20:47.657026 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.656959 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:20:47.659124 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.659094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd47t" event={"ID":"28b93950-4c7e-428e-bf79-aa152be2cee6","Type":"ContainerStarted","Data":"7541b2f116c5d5b94eb71e5d5b480abd24b3c1f87202808bd60ff88d344b94ed"} Jul 16 17:20:47.659248 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.659149 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd47t" event={"ID":"28b93950-4c7e-428e-bf79-aa152be2cee6","Type":"ContainerStarted","Data":"1027fbd394bf80eb7e731fb8931c5c143fd7be5e7957dcc8ab9984c77f14ee29"} Jul 16 17:20:47.659430 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.659412 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:47.660798 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.660772 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b7bc4f64d-dt8h4" Jul 16 17:20:47.677241 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.677185 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" podStartSLOduration=47.677163985 podStartE2EDuration="47.677163985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:47.675165981 +0000 UTC m=+70.996382146" watchObservedRunningTime="2026-07-16 17:20:47.677163985 +0000 UTC m=+70.998380155" Jul 16 17:20:47.708644 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.708530 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pd47t" podStartSLOduration=67.43905439 podStartE2EDuration="1m10.708513719s" totalImagesPullingTime="3.269459329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:47.708456475 +0000 UTC m=+71.029672664" watchObservedRunningTime="2026-07-16 17:20:47.708513719 +0000 UTC m=+71.029729884" Jul 16 17:20:47.915229 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.915187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:47.971728 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:47.971691 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:48.708453 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.708395 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:48.812512 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.812469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:48.832052 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.832020 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d85c94984-tlfpv"] Jul 16 17:20:48.834650 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.834626 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:48.843632 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.843604 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 17:20:48.847280 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.847252 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d85c94984-tlfpv"] Jul 16 17:20:48.886599 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.886553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:48.959166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.958666 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-oauth-config\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:48.959166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.958720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-console-config\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:48.959166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.958752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqd48\" (UniqueName: \"kubernetes.io/projected/1f6a5ead-b528-4098-a6df-3eb59be87446-kube-api-access-wqd48\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:48.959166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.958777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-oauth-serving-cert\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:48.959166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.958838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-trusted-ca-bundle\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:48.959166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.958955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-serving-cert\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:48.959166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:48.958990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-service-ca\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.059791 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.059759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-trusted-ca-bundle\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060050 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.059890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-serving-cert\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060050 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.059917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-service-ca\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060050 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.059946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-oauth-config\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060227 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.060140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-console-config\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060227 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.060180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqd48\" (UniqueName: \"kubernetes.io/projected/1f6a5ead-b528-4098-a6df-3eb59be87446-kube-api-access-wqd48\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060227 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.060211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-oauth-serving-cert\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060728 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.060666 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-service-ca\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060728 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.060694 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-trusted-ca-bundle\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.060944 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.060893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-oauth-serving-cert\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.061007 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.060958 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-console-config\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.062341 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.062320 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-oauth-config\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.062591 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.062562 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-serving-cert\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.068459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.068439 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqd48\" (UniqueName: \"kubernetes.io/projected/1f6a5ead-b528-4098-a6df-3eb59be87446-kube-api-access-wqd48\") pod \"console-d85c94984-tlfpv\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.117972 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.117916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:49.148288 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.148228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:20:49.218574 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.218466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:49.797736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:49.797683 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cd676545-wgzw8"] Jul 16 17:20:50.129431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.129376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:50.169962 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:50.169696 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e63f6a_105a_401d_a50b_aafd1457189e.slice/crio-63ce0b441ba8016b260b8998db08c49a72bf66bfa4738d1130c5952186f03f31 WatchSource:0}: Error finding container 63ce0b441ba8016b260b8998db08c49a72bf66bfa4738d1130c5952186f03f31: Status 404 returned error can't find the container with id 63ce0b441ba8016b260b8998db08c49a72bf66bfa4738d1130c5952186f03f31 Jul 16 17:20:50.406745 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.406636 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-8p5rc"] Jul 16 17:20:50.437521 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:50.437321 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d9dd9f3_655c_449c_b2eb_2b666d4a7091.slice/crio-6003aea04a403829c886b960d72199097893db1577e389c07cfde29e16280158 WatchSource:0}: Error finding container 6003aea04a403829c886b960d72199097893db1577e389c07cfde29e16280158: Status 404 returned error can't find the container with id 6003aea04a403829c886b960d72199097893db1577e389c07cfde29e16280158 Jul 16 17:20:50.440334 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.440094 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8"] Jul 16 17:20:50.660985 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.660904 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-q2nxz"] Jul 16 17:20:50.663804 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.663775 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d85c94984-tlfpv"] Jul 16 17:20:50.664535 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:50.664510 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5732757_e4db_4cf5_a4a4_0d94791abda4.slice/crio-07858cb20bb8efe1ec86dc3b088d944fd63d48c2179d967419e332600f5f9da9 WatchSource:0}: Error finding container 07858cb20bb8efe1ec86dc3b088d944fd63d48c2179d967419e332600f5f9da9: Status 404 returned error can't find the container with id 07858cb20bb8efe1ec86dc3b088d944fd63d48c2179d967419e332600f5f9da9 Jul 16 17:20:50.668789 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.668750 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7"] Jul 16 17:20:50.674735 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:50.674647 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6a5ead_b528_4098_a6df_3eb59be87446.slice/crio-cbba586c736bc1d59c1ea3c5a2b84b2c567e81db59f65259a1644b9553d56eac WatchSource:0}: Error finding container cbba586c736bc1d59c1ea3c5a2b84b2c567e81db59f65259a1644b9553d56eac: Status 404 returned error can't find the container with id cbba586c736bc1d59c1ea3c5a2b84b2c567e81db59f65259a1644b9553d56eac Jul 16 17:20:50.680112 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.680074 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b"] Jul 16 17:20:50.682339 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.682312 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f964c" event={"ID":"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19","Type":"ContainerStarted","Data":"140523e51e6234cb8b14c0f8b992bba1e37d01f71aaa9b0ca0e0a21ee3830f77"} Jul 16 17:20:50.682449 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.682369 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f964c" event={"ID":"0c0a9fe5-b012-46d4-9f21-e5a3a8592f19","Type":"ContainerStarted","Data":"3bab6a0c87c393299afd4640ac6f09bca237cc4836ab1b682d5db16b8c4000f6"} Jul 16 17:20:50.682699 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.682648 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f964c" Jul 16 17:20:50.684139 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:50.684117 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b4ff353_2dcc_4389_a52d_6ae246bb386f.slice/crio-37c680e8a69188f6b6e2c1cf8be4a2fdeb2fa31e92b04a792a7e83e2e96a3078 WatchSource:0}: Error finding container 37c680e8a69188f6b6e2c1cf8be4a2fdeb2fa31e92b04a792a7e83e2e96a3078: Status 404 returned error can't find the container with id 37c680e8a69188f6b6e2c1cf8be4a2fdeb2fa31e92b04a792a7e83e2e96a3078 Jul 16 17:20:50.684464 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.684426 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-q2nxz" event={"ID":"c5732757-e4db-4cf5-a4a4-0d94791abda4","Type":"ContainerStarted","Data":"07858cb20bb8efe1ec86dc3b088d944fd63d48c2179d967419e332600f5f9da9"} Jul 16 17:20:50.685758 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.685736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" event={"ID":"5fec9a68-0ff8-4d95-ab71-ab7a136504f0","Type":"ContainerStarted","Data":"d8711a712c94f73c9a4cde4b87ad421b1d329e862f7234faba8a8677dbdc0c62"} Jul 16 17:20:50.687394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.687370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cd676545-wgzw8" event={"ID":"62e63f6a-105a-401d-a50b-aafd1457189e","Type":"ContainerStarted","Data":"63ce0b441ba8016b260b8998db08c49a72bf66bfa4738d1130c5952186f03f31"} Jul 16 17:20:50.689569 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.689545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" event={"ID":"90c8c6f6-8377-4672-8217-756ba6aaf696","Type":"ContainerStarted","Data":"82c961987bfe8edbdf017a93f74c4d48fdd45f62ee58aff810a6015f15e80fda"} Jul 16 17:20:50.689663 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.689592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" event={"ID":"90c8c6f6-8377-4672-8217-756ba6aaf696","Type":"ContainerStarted","Data":"41a4dfa0cf969a508b6724f5f40b732f73c19764d7aff604e75c15e52ed94c4e"} Jul 16 17:20:50.691385 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.691347 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" event={"ID":"16fadc42-e835-45ea-b1e3-9cd4656a73c8","Type":"ContainerStarted","Data":"7813181892a86ca26f3da224aaf30b7ed5c6944ceab349f6803884c0b30999b9"} Jul 16 17:20:50.692707 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.692683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" event={"ID":"2d9dd9f3-655c-449c-b2eb-2b666d4a7091","Type":"ContainerStarted","Data":"6003aea04a403829c886b960d72199097893db1577e389c07cfde29e16280158"} Jul 16 17:20:50.697411 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.697387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xjcjr" event={"ID":"a0823601-1c1f-4a81-9212-3ef17f75c8e3","Type":"ContainerStarted","Data":"3cda77ac2aa8fdeef8ff856eebb82e52fb1584bf8ade6ba82af5b10774fa687d"} Jul 16 17:20:50.705006 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.704953 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f964c" podStartSLOduration=33.938089175 podStartE2EDuration="37.704938671s" totalImagesPullingTime="3.766849496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:50.70443989 +0000 UTC m=+74.025656057" watchObservedRunningTime="2026-07-16 17:20:50.704938671 +0000 UTC m=+74.026154836" Jul 16 17:20:50.726471 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.726411 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6qhmt" podStartSLOduration=59.863883492 podStartE2EDuration="1m3.726393522s" totalImagesPullingTime="3.86251003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:50.725733049 +0000 UTC m=+74.046949214" watchObservedRunningTime="2026-07-16 17:20:50.726393522 +0000 UTC m=+74.047609687" Jul 16 17:20:50.752293 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.752236 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xjcjr" podStartSLOduration=65.863187509 podStartE2EDuration="1m12.752217238s" totalImagesPullingTime="6.889029729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:50.752168595 +0000 UTC m=+74.073384770" watchObservedRunningTime="2026-07-16 17:20:50.752217238 +0000 UTC m=+74.073433402" Jul 16 17:20:50.771806 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.771745 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9ffkm" podStartSLOduration=69.739271716 podStartE2EDuration="1m13.771729449s" totalImagesPullingTime="4.032457733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:20:50.770277742 +0000 UTC m=+74.091493906" watchObservedRunningTime="2026-07-16 17:20:50.771729449 +0000 UTC m=+74.092945612" Jul 16 17:20:50.934126 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.934042 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7"] Jul 16 17:20:50.939030 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.939009 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" Jul 16 17:20:50.941014 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.940980 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 17:20:50.941133 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.941035 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fz6tr\"" Jul 16 17:20:50.949424 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.949389 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7"] Jul 16 17:20:50.977793 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:50.977756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/43379f93-136c-4e66-9a77-a314683ca797-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-8nkl7\" (UID: \"43379f93-136c-4e66-9a77-a314683ca797\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" Jul 16 17:20:51.079226 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.079190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/43379f93-136c-4e66-9a77-a314683ca797-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-8nkl7\" (UID: \"43379f93-136c-4e66-9a77-a314683ca797\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" Jul 16 17:20:51.084989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.082237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/43379f93-136c-4e66-9a77-a314683ca797-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-8nkl7\" (UID: \"43379f93-136c-4e66-9a77-a314683ca797\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" Jul 16 17:20:51.134478 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.134441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:51.194260 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.194176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:51.250257 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.249989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" Jul 16 17:20:51.419115 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.419081 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7"] Jul 16 17:20:51.423500 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:20:51.423460 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43379f93_136c_4e66_9a77_a314683ca797.slice/crio-a89101676b0ccde452775f1e5918425ca22ffdcb491b06ad8019875ac9263179 WatchSource:0}: Error finding container a89101676b0ccde452775f1e5918425ca22ffdcb491b06ad8019875ac9263179: Status 404 returned error can't find the container with id a89101676b0ccde452775f1e5918425ca22ffdcb491b06ad8019875ac9263179 Jul 16 17:20:51.705735 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.705695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" event={"ID":"43379f93-136c-4e66-9a77-a314683ca797","Type":"ContainerStarted","Data":"a89101676b0ccde452775f1e5918425ca22ffdcb491b06ad8019875ac9263179"} Jul 16 17:20:51.707032 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.707003 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" event={"ID":"7b4ff353-2dcc-4389-a52d-6ae246bb386f","Type":"ContainerStarted","Data":"37c680e8a69188f6b6e2c1cf8be4a2fdeb2fa31e92b04a792a7e83e2e96a3078"} Jul 16 17:20:51.708705 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.708675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d85c94984-tlfpv" event={"ID":"1f6a5ead-b528-4098-a6df-3eb59be87446","Type":"ContainerStarted","Data":"cbba586c736bc1d59c1ea3c5a2b84b2c567e81db59f65259a1644b9553d56eac"} Jul 16 17:20:51.710016 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:51.709980 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" event={"ID":"b051f5a2-0c02-4163-81e8-e3b40899829c","Type":"ContainerStarted","Data":"5aa52a1f1878e8868492bf16db97cf69827574402d00514794148a9c4ce0cce0"} Jul 16 17:20:52.674948 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:52.674890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:54.424315 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:54.424250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:54.487491 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:54.487440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:56.429579 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:56.429537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:56.528851 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:56.528786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:59.410092 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:59.410010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:20:59.462477 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:20:59.462416 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:00.713223 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:00.713188 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f964c" Jul 16 17:21:01.006763 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.006696 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:01.105367 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.105195 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:01.450894 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.450856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:01.779334 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.779247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d85c94984-tlfpv" event={"ID":"1f6a5ead-b528-4098-a6df-3eb59be87446","Type":"ContainerStarted","Data":"31e5a64f05a655cfff0f6a16f2900bec9c9108f033a28eac99b679baae4ff2f8"} Jul 16 17:21:01.781286 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.781234 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" event={"ID":"b051f5a2-0c02-4163-81e8-e3b40899829c","Type":"ContainerStarted","Data":"4cbb1da42fc3dbd7d293893f3affe1ad6b16e317210f6310bbff74ecc9248074"} Jul 16 17:21:01.781559 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.781535 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:21:01.783412 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.783383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" event={"ID":"5fec9a68-0ff8-4d95-ab71-ab7a136504f0","Type":"ContainerStarted","Data":"00bf223fa72cbcd8ee267db73310b791fcdeab72312b543c720fefa9ba9e89f7"} Jul 16 17:21:01.784174 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.783807 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" Jul 16 17:21:01.785745 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.785583 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cd676545-wgzw8" event={"ID":"62e63f6a-105a-401d-a50b-aafd1457189e","Type":"ContainerStarted","Data":"780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38"} Jul 16 17:21:01.787505 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.787482 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" event={"ID":"2d9dd9f3-655c-449c-b2eb-2b666d4a7091","Type":"ContainerStarted","Data":"4bcea79b72c38513dce76111f179b228b9c55ad9c7bf19d1015aa271ced2d245"} Jul 16 17:21:01.789229 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.789208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" event={"ID":"43379f93-136c-4e66-9a77-a314683ca797","Type":"ContainerStarted","Data":"5c0baeeb0269566927a3936a7bb2ae0e377d7ce44212b0ffc09869be262f812a"} Jul 16 17:21:01.789332 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.789253 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" Jul 16 17:21:01.792678 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.791988 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" event={"ID":"7b4ff353-2dcc-4389-a52d-6ae246bb386f","Type":"ContainerStarted","Data":"3ef70e274a1cac438e4ebd4a36ad39636caafde16aa84b1a569d57109f8e5606"} Jul 16 17:21:01.792678 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.792026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" event={"ID":"7b4ff353-2dcc-4389-a52d-6ae246bb386f","Type":"ContainerStarted","Data":"61dd3f7b32113fa67ea5d753c60b224284c3fe1e9e1df19f03b2f62be176f52c"} Jul 16 17:21:01.792678 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.792043 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" event={"ID":"7b4ff353-2dcc-4389-a52d-6ae246bb386f","Type":"ContainerStarted","Data":"1bdec23c4e7e90b2dcc084f13f43db9b9229edb5b5efb5cfcd27be2afc93aca1"} Jul 16 17:21:01.796210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.796191 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" Jul 16 17:21:01.797040 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.796987 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d85c94984-tlfpv" podStartSLOduration=3.68479981 podStartE2EDuration="13.796933473s" totalImagesPullingTime="10.112133663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:01.795577465 +0000 UTC m=+85.116793656" watchObservedRunningTime="2026-07-16 17:21:01.796933473 +0000 UTC m=+85.118149638" Jul 16 17:21:01.812381 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.812335 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7946d9b-w57n8" podStartSLOduration=5.475195502 podStartE2EDuration="15.81231572s" totalImagesPullingTime="10.337120218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:01.81092963 +0000 UTC m=+85.132145795" watchObservedRunningTime="2026-07-16 17:21:01.81231572 +0000 UTC m=+85.133531885" Jul 16 17:21:01.825213 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.825165 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8nkl7" podStartSLOduration=2.491782372 podStartE2EDuration="11.825150447s" totalImagesPullingTime="9.333368075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:01.823248455 +0000 UTC m=+85.144464620" watchObservedRunningTime="2026-07-16 17:21:01.825150447 +0000 UTC m=+85.146366610" Jul 16 17:21:01.838906 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.838849 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-8p5rc" podStartSLOduration=5.475901816 podStartE2EDuration="15.838810241s" totalImagesPullingTime="10.362908425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:01.837899403 +0000 UTC m=+85.159115599" watchObservedRunningTime="2026-07-16 17:21:01.838810241 +0000 UTC m=+85.160026406" Jul 16 17:21:01.884281 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.884215 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5f84c7c-5vgw7" podStartSLOduration=5.778320888 podStartE2EDuration="15.884191333s" totalImagesPullingTime="10.105870445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:01.882073271 +0000 UTC m=+85.203289439" watchObservedRunningTime="2026-07-16 17:21:01.884191333 +0000 UTC m=+85.205407498" Jul 16 17:21:01.915829 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.915751 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77664c5759-tbw2b" podStartSLOduration=5.838369729 podStartE2EDuration="15.915728764s" totalImagesPullingTime="10.077359035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:01.913900021 +0000 UTC m=+85.235116185" watchObservedRunningTime="2026-07-16 17:21:01.915728764 +0000 UTC m=+85.236944926" Jul 16 17:21:01.937191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:01.937094 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56cd676545-wgzw8" podStartSLOduration=4.334610091 podStartE2EDuration="14.937072284s" totalImagesPullingTime="10.602462193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:01.93576374 +0000 UTC m=+85.256979903" watchObservedRunningTime="2026-07-16 17:21:01.937072284 +0000 UTC m=+85.258288449" Jul 16 17:21:02.155132 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.155094 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gwmln"] Jul 16 17:21:02.158453 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.158347 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.160526 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.160386 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 17:21:02.160526 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.160425 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 17:21:02.160526 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.160498 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fgb4h\"" Jul 16 17:21:02.169269 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.168843 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gwmln"] Jul 16 17:21:02.197024 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.196966 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:02.254716 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.254678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:02.290018 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.289982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.290214 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.290035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90b7c1e1-6515-4c73-a532-58aaf03696a9-data-volume\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.290214 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.290105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90b7c1e1-6515-4c73-a532-58aaf03696a9-crio-socket\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.290214 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.290133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.290214 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.290160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6ttl\" (UniqueName: \"kubernetes.io/projected/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-api-access-t6ttl\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.391263 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.391230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.391467 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.391271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90b7c1e1-6515-4c73-a532-58aaf03696a9-data-volume\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.391467 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.391318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90b7c1e1-6515-4c73-a532-58aaf03696a9-crio-socket\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.391467 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:02.391376 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:21:02.391467 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.391404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.391467 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.391427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6ttl\" (UniqueName: \"kubernetes.io/projected/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-api-access-t6ttl\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.391467 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:02.391444 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:02.891426441 +0000 UTC m=+86.212642583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : configmap "kube-rbac-proxy" not found Jul 16 17:21:02.391792 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.391386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90b7c1e1-6515-4c73-a532-58aaf03696a9-crio-socket\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.391792 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:02.391540 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:21:02.391792 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:02.391596 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:02.891579452 +0000 UTC m=+86.212795612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : secret "insights-runtime-extractor-tls" not found Jul 16 17:21:02.391792 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.391728 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90b7c1e1-6515-4c73-a532-58aaf03696a9-data-volume\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.400302 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.400275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6ttl\" (UniqueName: \"kubernetes.io/projected/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-api-access-t6ttl\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.452023 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.451932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:02.551992 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.551928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:02.897388 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.897343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.897848 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:02.897468 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:21:02.897848 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:02.897546 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:03.897524971 +0000 UTC m=+87.218741126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : secret "insights-runtime-extractor-tls" not found Jul 16 17:21:02.897968 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.897916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:02.898065 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:02.898045 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:21:02.898148 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:02.898108 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:03.898094442 +0000 UTC m=+87.219310598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : configmap "kube-rbac-proxy" not found Jul 16 17:21:02.968431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:02.968393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:03.040956 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:03.040918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:03.287461 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:03.287357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:03.908347 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:03.908307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:03.908856 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:03.908467 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:21:03.908856 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:03.908523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:03.908856 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:03.908549 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:05.908529427 +0000 UTC m=+89.229745572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : configmap "kube-rbac-proxy" not found Jul 16 17:21:03.908856 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:03.908617 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:21:03.908856 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:03.908686 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:05.908670056 +0000 UTC m=+89.229886199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : secret "insights-runtime-extractor-tls" not found Jul 16 17:21:03.949939 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:03.949903 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-xznv2_603a7915-9507-47fd-af9c-5bb6670da635/networking-console-plugin/0.log" Jul 16 17:21:04.148833 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:04.148774 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:21:04.353550 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:04.353426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/2.log" Jul 16 17:21:04.549943 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:04.549906 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56cd676545-wgzw8_62e63f6a-105a-401d-a50b-aafd1457189e/console/0.log" Jul 16 17:21:04.750396 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:04.750367 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d85c94984-tlfpv_1f6a5ead-b528-4098-a6df-3eb59be87446/console/0.log" Jul 16 17:21:05.123910 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:05.123875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:05.149632 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:05.149603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f964c_0c0a9fe5-b012-46d4-9f21-e5a3a8592f19/dns/0.log" Jul 16 17:21:05.211100 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:05.211067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:05.349635 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:05.349603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f964c_0c0a9fe5-b012-46d4-9f21-e5a3a8592f19/kube-rbac-proxy/0.log" Jul 16 17:21:05.723681 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:05.723640 2579 patch_prober.go:28] interesting pod/image-registry-6544cd8c58-2wghd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 17:21:05.723884 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:05.723713 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" podUID="860255e6-bcd3-4840-b625-f3f4f6af2502" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 17:21:05.928182 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:05.928142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:05.928377 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:05.928231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:05.928377 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:05.928293 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:21:05.928494 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:05.928378 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:09.928357032 +0000 UTC m=+93.249573177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : configmap "kube-rbac-proxy" not found Jul 16 17:21:05.928494 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:05.928413 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:21:05.928494 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:05.928467 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:09.928450916 +0000 UTC m=+93.249667058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : secret "insights-runtime-extractor-tls" not found Jul 16 17:21:06.148937 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:06.148903 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpq8m_a1a3b005-42b7-4098-8e5f-49da0a9abeed/dns-node-resolver/0.log" Jul 16 17:21:06.549808 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:06.549729 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57df49f845-vg9nj_de0d20d5-de0d-4c23-b1c1-01d77d940101/registry/0.log" Jul 16 17:21:06.751179 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:06.751136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6544cd8c58-2wghd_860255e6-bcd3-4840-b625-f3f4f6af2502/registry/0.log" Jul 16 17:21:07.242671 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.242609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:07.344159 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.343992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:07.397027 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.396992 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:21:07.397220 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.397063 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:21:07.403215 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.403191 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:21:07.425722 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.425615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:07.548915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.548841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z4b9c_9e0c60c3-8e2c-42ce-a438-767c1386938e/node-ca/0.log" Jul 16 17:21:07.666135 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.666093 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:21:07.749587 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.749524 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7bc4f64d-dt8h4_15b2c949-fa93-4a22-bb20-bdf8c250d20a/router/0.log" Jul 16 17:21:07.826560 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.826481 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:21:07.948675 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.948589 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9sbhl_7d44c547-b9b3-4cd8-984d-2141e733bd84/serve-healthcheck-canary/0.log" Jul 16 17:21:07.959719 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:07.959681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:08.246359 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:08.246305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:08.361354 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:08.361323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:08.461665 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:08.461601 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:08.661985 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:08.661945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:08.669029 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:08.669004 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:21:08.765320 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:08.765278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:08.863266 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:08.863226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:08.961765 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:08.961685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:09.149033 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.148996 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:21:09.149223 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.149068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:21:09.155147 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.155120 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:21:09.833796 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.833753 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:09.839089 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.839068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:21:09.883927 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.883886 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56cd676545-wgzw8"] Jul 16 17:21:09.973010 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.972940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:09.973215 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:09.973103 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 17:21:09.973215 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.973133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:09.973215 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:09.973173 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:17.973154024 +0000 UTC m=+101.294370173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : secret "insights-runtime-extractor-tls" not found Jul 16 17:21:09.973215 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:09.973209 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 17:21:09.973494 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:09.973244 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm podName:90b7c1e1-6515-4c73-a532-58aaf03696a9 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:17.973233327 +0000 UTC m=+101.294449484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gwmln" (UID: "90b7c1e1-6515-4c73-a532-58aaf03696a9") : configmap "kube-rbac-proxy" not found Jul 16 17:21:09.986928 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:09.986897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:10.087931 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:10.087857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:10.188916 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:10.188882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:10.288724 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:10.288693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:10.842723 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:10.842683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-q2nxz" event={"ID":"c5732757-e4db-4cf5-a4a4-0d94791abda4","Type":"ContainerStarted","Data":"a64b197992dc6c44cd12774fcdf675563a52901bc9015ec0253b5354dd2da3b3"} Jul 16 17:21:10.859659 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:10.859592 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-q2nxz" podStartSLOduration=5.323344281 podStartE2EDuration="24.859575538s" totalImagesPullingTime="19.536231257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:10.858275717 +0000 UTC m=+94.179491884" watchObservedRunningTime="2026-07-16 17:21:10.859575538 +0000 UTC m=+94.180791701" Jul 16 17:21:11.106127 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.106009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:11.320381 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.320338 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:11.380592 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.380536 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dnwb6"] Jul 16 17:21:11.401458 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.401421 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:11.412077 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.412045 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.417168 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.416166 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-swmgg\"" Jul 16 17:21:11.417168 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.416402 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 17:21:11.417168 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.416584 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 17:21:11.417168 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.416769 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 17:21:11.417168 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.416984 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 17:21:11.489243 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.489202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.489626 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.489600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-sys\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.489856 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.489802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-root\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.489937 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.489911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kspt\" (UniqueName: \"kubernetes.io/projected/ece7f8fd-b8dc-4c06-8078-460b82fe3796-kube-api-access-9kspt\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.490016 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.489985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.490016 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.490013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece7f8fd-b8dc-4c06-8078-460b82fe3796-metrics-client-ca\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.490196 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.490041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-textfile\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.490196 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.490087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-wtmp\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.490196 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.490163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-accelerators-collector-config\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.591474 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.591669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece7f8fd-b8dc-4c06-8078-460b82fe3796-metrics-client-ca\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.591669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-textfile\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.591669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-wtmp\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.591669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-accelerators-collector-config\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.591669 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:11.591617 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 17:21:11.591669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.592014 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:11.591693 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls podName:ece7f8fd-b8dc-4c06-8078-460b82fe3796 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:12.091671192 +0000 UTC m=+95.412887340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls") pod "node-exporter-dnwb6" (UID: "ece7f8fd-b8dc-4c06-8078-460b82fe3796") : secret "node-exporter-tls" not found Jul 16 17:21:11.592014 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-sys\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.592014 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591838 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-root\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.592014 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.591900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kspt\" (UniqueName: \"kubernetes.io/projected/ece7f8fd-b8dc-4c06-8078-460b82fe3796-kube-api-access-9kspt\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.592462 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.592433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-sys\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.592462 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.592437 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-textfile\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.592636 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.592516 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-root\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.592689 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.592652 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-wtmp\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.593095 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.593070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece7f8fd-b8dc-4c06-8078-460b82fe3796-metrics-client-ca\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.593200 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.593177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-accelerators-collector-config\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.597508 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.597486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.601023 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.600996 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kspt\" (UniqueName: \"kubernetes.io/projected/ece7f8fd-b8dc-4c06-8078-460b82fe3796-kube-api-access-9kspt\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:11.641500 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.641410 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:11.744368 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.744326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:11.843968 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.843927 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:11.848003 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.847971 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-q2nxz" Jul 16 17:21:11.867093 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.867061 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-q2nxz" Jul 16 17:21:11.943971 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:11.943882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:12.099044 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.098991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:12.099241 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:12.099172 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 17:21:12.099315 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:12.099267 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls podName:ece7f8fd-b8dc-4c06-8078-460b82fe3796 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:13.099242843 +0000 UTC m=+96.420458993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls") pod "node-exporter-dnwb6" (UID: "ece7f8fd-b8dc-4c06-8078-460b82fe3796") : secret "node-exporter-tls" not found Jul 16 17:21:12.125579 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.125535 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:12.214146 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.214018 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:12.330383 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.330350 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:12.422710 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.422672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:12.683527 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.683474 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" podUID="de0d20d5-de0d-4c23-b1c1-01d77d940101" containerName="registry" containerID="cri-o://82ea5bf2329ac6d8cc197ef64f6e24104799f3acd1b70e0d0c6da40bacd157c6" gracePeriod=30 Jul 16 17:21:12.840575 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.840532 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:12.855925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.855888 2579 generic.go:356] "Generic (PLEG): container finished" podID="de0d20d5-de0d-4c23-b1c1-01d77d940101" containerID="82ea5bf2329ac6d8cc197ef64f6e24104799f3acd1b70e0d0c6da40bacd157c6" exitCode=0 Jul 16 17:21:12.856459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:12.856430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" event={"ID":"de0d20d5-de0d-4c23-b1c1-01d77d940101","Type":"ContainerDied","Data":"82ea5bf2329ac6d8cc197ef64f6e24104799f3acd1b70e0d0c6da40bacd157c6"} Jul 16 17:21:13.004463 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.004432 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:21:13.108883 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.108848 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0d20d5-de0d-4c23-b1c1-01d77d940101-ca-trust-extracted\") pod \"de0d20d5-de0d-4c23-b1c1-01d77d940101\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " Jul 16 17:21:13.109069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.108946 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-trusted-ca\") pod \"de0d20d5-de0d-4c23-b1c1-01d77d940101\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " Jul 16 17:21:13.109069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.108987 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsc2d\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-kube-api-access-lsc2d\") pod \"de0d20d5-de0d-4c23-b1c1-01d77d940101\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " Jul 16 17:21:13.109069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.109019 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-image-registry-private-configuration\") pod \"de0d20d5-de0d-4c23-b1c1-01d77d940101\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " Jul 16 17:21:13.109069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.109054 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-installation-pull-secrets\") pod \"de0d20d5-de0d-4c23-b1c1-01d77d940101\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " Jul 16 17:21:13.109255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.109113 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-certificates\") pod \"de0d20d5-de0d-4c23-b1c1-01d77d940101\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " Jul 16 17:21:13.109255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.109142 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-bound-sa-token\") pod \"de0d20d5-de0d-4c23-b1c1-01d77d940101\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " Jul 16 17:21:13.109255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.109171 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") pod \"de0d20d5-de0d-4c23-b1c1-01d77d940101\" (UID: \"de0d20d5-de0d-4c23-b1c1-01d77d940101\") " Jul 16 17:21:13.109403 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.109380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:13.110926 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.110796 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "de0d20d5-de0d-4c23-b1c1-01d77d940101" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:21:13.111598 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.110949 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "de0d20d5-de0d-4c23-b1c1-01d77d940101" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:21:13.113969 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.113920 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "de0d20d5-de0d-4c23-b1c1-01d77d940101" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:21:13.114275 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.114231 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece7f8fd-b8dc-4c06-8078-460b82fe3796-node-exporter-tls\") pod \"node-exporter-dnwb6\" (UID: \"ece7f8fd-b8dc-4c06-8078-460b82fe3796\") " pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:13.115044 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.115016 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-kube-api-access-lsc2d" (OuterVolumeSpecName: "kube-api-access-lsc2d") pod "de0d20d5-de0d-4c23-b1c1-01d77d940101" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101"). InnerVolumeSpecName "kube-api-access-lsc2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:21:13.115411 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.115339 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "de0d20d5-de0d-4c23-b1c1-01d77d940101" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:21:13.115621 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.115591 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "de0d20d5-de0d-4c23-b1c1-01d77d940101" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:21:13.116283 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.116253 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "de0d20d5-de0d-4c23-b1c1-01d77d940101" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:21:13.122292 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.122103 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de0d20d5-de0d-4c23-b1c1-01d77d940101-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "de0d20d5-de0d-4c23-b1c1-01d77d940101" (UID: "de0d20d5-de0d-4c23-b1c1-01d77d940101"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:21:13.210114 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.210075 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de0d20d5-de0d-4c23-b1c1-01d77d940101-ca-trust-extracted\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:13.210114 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.210112 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-trusted-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:13.210351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.210125 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsc2d\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-kube-api-access-lsc2d\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:13.210351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.210139 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-image-registry-private-configuration\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:13.210351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.210152 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de0d20d5-de0d-4c23-b1c1-01d77d940101-installation-pull-secrets\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:13.210351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.210164 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-certificates\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:13.210351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.210177 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-bound-sa-token\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:13.210351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.210188 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de0d20d5-de0d-4c23-b1c1-01d77d940101-registry-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:13.227933 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.227866 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dnwb6" Jul 16 17:21:13.268323 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:21:13.268291 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece7f8fd_b8dc_4c06_8078_460b82fe3796.slice/crio-342b85d7259087c161f6d2974dc0ee76ce9efc0bcc4c64a21a3e6a0c08a73fcc WatchSource:0}: Error finding container 342b85d7259087c161f6d2974dc0ee76ce9efc0bcc4c64a21a3e6a0c08a73fcc: Status 404 returned error can't find the container with id 342b85d7259087c161f6d2974dc0ee76ce9efc0bcc4c64a21a3e6a0c08a73fcc Jul 16 17:21:13.819482 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.819437 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:13.864558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.864528 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" Jul 16 17:21:13.865280 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.864567 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57df49f845-vg9nj" event={"ID":"de0d20d5-de0d-4c23-b1c1-01d77d940101","Type":"ContainerDied","Data":"cba830fb69526200c6138db3deadec5202c356cca0c80bb066f686be8cc9a848"} Jul 16 17:21:13.865280 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.864677 2579 scope.go:117] "RemoveContainer" containerID="82ea5bf2329ac6d8cc197ef64f6e24104799f3acd1b70e0d0c6da40bacd157c6" Jul 16 17:21:13.868314 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.868253 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dnwb6" event={"ID":"ece7f8fd-b8dc-4c06-8078-460b82fe3796","Type":"ContainerStarted","Data":"342b85d7259087c161f6d2974dc0ee76ce9efc0bcc4c64a21a3e6a0c08a73fcc"} Jul 16 17:21:13.885110 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.885078 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57df49f845-vg9nj"] Jul 16 17:21:13.888192 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.888164 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:13.890897 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:13.890857 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57df49f845-vg9nj"] Jul 16 17:21:14.348598 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:14.348046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:14.433282 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:14.433249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:14.622211 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:14.622170 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-898mx" Jul 16 17:21:14.705982 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:14.705945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:14.786502 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:14.786466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:15.171094 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:15.171063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:15.221290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:15.221254 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de0d20d5-de0d-4c23-b1c1-01d77d940101" path="/var/lib/kubelet/pods/de0d20d5-de0d-4c23-b1c1-01d77d940101/volumes" Jul 16 17:21:15.553920 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:15.553856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:15.881271 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:15.881232 2579 generic.go:356] "Generic (PLEG): container finished" podID="ece7f8fd-b8dc-4c06-8078-460b82fe3796" containerID="5ddd62e4fc79ade18b8b557c38bfa66a09befec048a1aa1b361cd467a2cdef8b" exitCode=0 Jul 16 17:21:15.881470 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:15.881288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dnwb6" event={"ID":"ece7f8fd-b8dc-4c06-8078-460b82fe3796","Type":"ContainerDied","Data":"5ddd62e4fc79ade18b8b557c38bfa66a09befec048a1aa1b361cd467a2cdef8b"} Jul 16 17:21:16.154535 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:16.154423 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:16.240020 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:16.239983 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:16.447569 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:16.447430 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:16.535864 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:16.535797 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:16.811694 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:16.811533 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:16.889029 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:16.888992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dnwb6" event={"ID":"ece7f8fd-b8dc-4c06-8078-460b82fe3796","Type":"ContainerStarted","Data":"a511ee7aaa0e5cc293a7d11d22c2374a5d255125a17f75a762fec6220e463e70"} Jul 16 17:21:16.889209 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:16.889056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dnwb6" event={"ID":"ece7f8fd-b8dc-4c06-8078-460b82fe3796","Type":"ContainerStarted","Data":"8326192dc80f47c29df41b92c3c3363e1ca9d8eaf054ad4e10048fb3facba4a2"} Jul 16 17:21:16.910271 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:16.910216 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dnwb6" podStartSLOduration=4.090876153 podStartE2EDuration="5.910194004s" totalImagesPullingTime="1.714751437s" totalInitContainerRuntime="104.566414ms" isStatefulPod=true podCreationTimestamp="2026-07-16 17:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:16.909039758 +0000 UTC m=+100.230255957" watchObservedRunningTime="2026-07-16 17:21:16.910194004 +0000 UTC m=+100.231410160" Jul 16 17:21:17.371547 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:17.371500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:17.457650 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:17.457611 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:17.558589 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:17.558550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:17.718860 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:17.718744 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:18.064852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:18.064751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:18.065036 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:18.064908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:18.065583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:18.065558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90b7c1e1-6515-4c73-a532-58aaf03696a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:18.067576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:18.067546 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90b7c1e1-6515-4c73-a532-58aaf03696a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gwmln\" (UID: \"90b7c1e1-6515-4c73-a532-58aaf03696a9\") " pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:18.073491 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:18.073467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gwmln" Jul 16 17:21:18.272469 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:18.272432 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gwmln"] Jul 16 17:21:18.275329 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:21:18.275303 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b7c1e1_6515_4c73_a532_58aaf03696a9.slice/crio-c3a3d0cadadbb4521ff74c208c9172c919ab2090c8ffe70d768de7dd75e383ce WatchSource:0}: Error finding container c3a3d0cadadbb4521ff74c208c9172c919ab2090c8ffe70d768de7dd75e383ce: Status 404 returned error can't find the container with id c3a3d0cadadbb4521ff74c208c9172c919ab2090c8ffe70d768de7dd75e383ce Jul 16 17:21:18.901608 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:18.901563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwmln" event={"ID":"90b7c1e1-6515-4c73-a532-58aaf03696a9","Type":"ContainerStarted","Data":"c3a3d0cadadbb4521ff74c208c9172c919ab2090c8ffe70d768de7dd75e383ce"} Jul 16 17:21:19.522774 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:19.522730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:19.620306 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:19.620269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:21.169589 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:21.169546 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6544cd8c58-2wghd"] Jul 16 17:21:21.290018 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:21.289979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:21.391204 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:21.391172 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:23.001304 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:23.001270 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:23.082804 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:23.082764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:23.345787 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:23.345688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:23.406797 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:23.406751 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:25.290998 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:25.290931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:25.391736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:25.391635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:25.500673 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:25.500636 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:26.230691 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:26.230649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:26.292098 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:26.292063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:29.955795 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:29.955756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwmln" event={"ID":"90b7c1e1-6515-4c73-a532-58aaf03696a9","Type":"ContainerStarted","Data":"e93d81b9edc3b35910c94dec194a009f6da7ec154e7a6e4d90112e67caacc372"} Jul 16 17:21:33.653769 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:33.653726 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:33.718973 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:33.718933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:33.976729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:33.976701 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e" containerID="5d09204752a8b1077f1017dfd53130c993ad08f8647bb585d147c137834b7354" exitCode=0 Jul 16 17:21:33.976867 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:33.976776 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" event={"ID":"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e","Type":"ContainerDied","Data":"5d09204752a8b1077f1017dfd53130c993ad08f8647bb585d147c137834b7354"} Jul 16 17:21:33.977177 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:33.977160 2579 scope.go:117] "RemoveContainer" containerID="5d09204752a8b1077f1017dfd53130c993ad08f8647bb585d147c137834b7354" Jul 16 17:21:34.910660 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:34.910615 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56cd676545-wgzw8" podUID="62e63f6a-105a-401d-a50b-aafd1457189e" containerName="console" containerID="cri-o://780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38" gracePeriod=15 Jul 16 17:21:34.984543 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:34.984503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwmln" event={"ID":"90b7c1e1-6515-4c73-a532-58aaf03696a9","Type":"ContainerStarted","Data":"1fc4c0fcf012a326cf03e62d2e02775a31a4eeae6d53b2f4a048f2ab614d7812"} Jul 16 17:21:34.986627 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:34.986599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kg2zr" event={"ID":"8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e","Type":"ContainerStarted","Data":"6387374b216056e3aaf9bc3243d20d7a5992ba39dc0e4393c711274a600855a8"} Jul 16 17:21:35.229773 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.229745 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:21:35.322729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.322680 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-console-config\") pod \"62e63f6a-105a-401d-a50b-aafd1457189e\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " Jul 16 17:21:35.322940 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.322784 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8d5f\" (UniqueName: \"kubernetes.io/projected/62e63f6a-105a-401d-a50b-aafd1457189e-kube-api-access-l8d5f\") pod \"62e63f6a-105a-401d-a50b-aafd1457189e\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " Jul 16 17:21:35.322940 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.322830 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-oauth-config\") pod \"62e63f6a-105a-401d-a50b-aafd1457189e\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " Jul 16 17:21:35.322940 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.322909 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-service-ca\") pod \"62e63f6a-105a-401d-a50b-aafd1457189e\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " Jul 16 17:21:35.323115 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.322950 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-oauth-serving-cert\") pod \"62e63f6a-105a-401d-a50b-aafd1457189e\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " Jul 16 17:21:35.323115 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.322967 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-serving-cert\") pod \"62e63f6a-105a-401d-a50b-aafd1457189e\" (UID: \"62e63f6a-105a-401d-a50b-aafd1457189e\") " Jul 16 17:21:35.323262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.323189 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-console-config" (OuterVolumeSpecName: "console-config") pod "62e63f6a-105a-401d-a50b-aafd1457189e" (UID: "62e63f6a-105a-401d-a50b-aafd1457189e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:21:35.323500 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.323474 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "62e63f6a-105a-401d-a50b-aafd1457189e" (UID: "62e63f6a-105a-401d-a50b-aafd1457189e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:21:35.323717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.323692 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-service-ca" (OuterVolumeSpecName: "service-ca") pod "62e63f6a-105a-401d-a50b-aafd1457189e" (UID: "62e63f6a-105a-401d-a50b-aafd1457189e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:21:35.325737 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.325705 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "62e63f6a-105a-401d-a50b-aafd1457189e" (UID: "62e63f6a-105a-401d-a50b-aafd1457189e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:21:35.325861 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.325742 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62e63f6a-105a-401d-a50b-aafd1457189e-kube-api-access-l8d5f" (OuterVolumeSpecName: "kube-api-access-l8d5f") pod "62e63f6a-105a-401d-a50b-aafd1457189e" (UID: "62e63f6a-105a-401d-a50b-aafd1457189e"). InnerVolumeSpecName "kube-api-access-l8d5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:21:35.325861 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.325752 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "62e63f6a-105a-401d-a50b-aafd1457189e" (UID: "62e63f6a-105a-401d-a50b-aafd1457189e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:21:35.424580 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.424547 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-console-config\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:35.424580 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.424583 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8d5f\" (UniqueName: \"kubernetes.io/projected/62e63f6a-105a-401d-a50b-aafd1457189e-kube-api-access-l8d5f\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:35.424835 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.424601 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-oauth-config\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:35.424835 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.424610 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:35.424835 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.424621 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62e63f6a-105a-401d-a50b-aafd1457189e-oauth-serving-cert\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:35.424835 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.424629 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62e63f6a-105a-401d-a50b-aafd1457189e-console-serving-cert\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:35.993289 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.993250 2579 generic.go:356] "Generic (PLEG): container finished" podID="62e63f6a-105a-401d-a50b-aafd1457189e" containerID="780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38" exitCode=0 Jul 16 17:21:35.993780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.993313 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cd676545-wgzw8" Jul 16 17:21:35.993780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.993366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cd676545-wgzw8" event={"ID":"62e63f6a-105a-401d-a50b-aafd1457189e","Type":"ContainerDied","Data":"780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38"} Jul 16 17:21:35.993780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.993434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cd676545-wgzw8" event={"ID":"62e63f6a-105a-401d-a50b-aafd1457189e","Type":"ContainerDied","Data":"63ce0b441ba8016b260b8998db08c49a72bf66bfa4738d1130c5952186f03f31"} Jul 16 17:21:35.993780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:35.993467 2579 scope.go:117] "RemoveContainer" containerID="780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38" Jul 16 17:21:36.004400 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:36.004379 2579 scope.go:117] "RemoveContainer" containerID="780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38" Jul 16 17:21:36.004702 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:36.004669 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38\": container with ID starting with 780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38 not found: ID does not exist" containerID="780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38" Jul 16 17:21:36.004795 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:36.004708 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38"} err="failed to get container status \"780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38\": rpc error: code = NotFound desc = could not find container \"780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38\": container with ID starting with 780597e031a0247fe66b17ba4ca242d217cdb07b22c357e402f633703ef93d38 not found: ID does not exist" Jul 16 17:21:36.015608 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:36.015578 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56cd676545-wgzw8"] Jul 16 17:21:36.023353 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:36.023324 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56cd676545-wgzw8"] Jul 16 17:21:37.220146 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:37.220109 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62e63f6a-105a-401d-a50b-aafd1457189e" path="/var/lib/kubelet/pods/62e63f6a-105a-401d-a50b-aafd1457189e/volumes" Jul 16 17:21:37.576390 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:37.576268 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d85c94984-tlfpv"] Jul 16 17:21:37.681015 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:37.680978 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:37.738046 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:37.738007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:39.010921 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:39.010882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gwmln" event={"ID":"90b7c1e1-6515-4c73-a532-58aaf03696a9","Type":"ContainerStarted","Data":"06b2bccab39b9b8033768987d1c7dcf5542a89ce7d949eaa748e74edf8254170"} Jul 16 17:21:39.027806 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:39.027757 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gwmln" podStartSLOduration=17.063865231 podStartE2EDuration="37.027739949s" totalImagesPullingTime="19.963874718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:21:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:39.026024593 +0000 UTC m=+122.347240767" watchObservedRunningTime="2026-07-16 17:21:39.027739949 +0000 UTC m=+122.348956113" Jul 16 17:21:43.094830 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:43.094777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:45.282905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:45.282869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:45.383421 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:45.383381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:45.441746 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:45.441713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:46.190942 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.190886 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" podUID="860255e6-bcd3-4840-b625-f3f4f6af2502" containerName="registry" containerID="cri-o://ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d" gracePeriod=30 Jul 16 17:21:46.468595 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.468509 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:21:46.525685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.525639 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") pod \"860255e6-bcd3-4840-b625-f3f4f6af2502\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " Jul 16 17:21:46.525887 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.525727 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-image-registry-private-configuration\") pod \"860255e6-bcd3-4840-b625-f3f4f6af2502\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " Jul 16 17:21:46.525887 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.525747 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-bound-sa-token\") pod \"860255e6-bcd3-4840-b625-f3f4f6af2502\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " Jul 16 17:21:46.525887 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.525763 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-installation-pull-secrets\") pod \"860255e6-bcd3-4840-b625-f3f4f6af2502\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " Jul 16 17:21:46.525887 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.525781 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fnd8\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-kube-api-access-2fnd8\") pod \"860255e6-bcd3-4840-b625-f3f4f6af2502\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " Jul 16 17:21:46.525887 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.525802 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-trusted-ca\") pod \"860255e6-bcd3-4840-b625-f3f4f6af2502\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " Jul 16 17:21:46.525887 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.525858 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-certificates\") pod \"860255e6-bcd3-4840-b625-f3f4f6af2502\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " Jul 16 17:21:46.526198 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.525913 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860255e6-bcd3-4840-b625-f3f4f6af2502-ca-trust-extracted\") pod \"860255e6-bcd3-4840-b625-f3f4f6af2502\" (UID: \"860255e6-bcd3-4840-b625-f3f4f6af2502\") " Jul 16 17:21:46.526438 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.526402 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "860255e6-bcd3-4840-b625-f3f4f6af2502" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:21:46.526930 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.526900 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "860255e6-bcd3-4840-b625-f3f4f6af2502" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:21:46.528286 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.528255 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "860255e6-bcd3-4840-b625-f3f4f6af2502" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:21:46.528583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.528556 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-kube-api-access-2fnd8" (OuterVolumeSpecName: "kube-api-access-2fnd8") pod "860255e6-bcd3-4840-b625-f3f4f6af2502" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502"). InnerVolumeSpecName "kube-api-access-2fnd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:21:46.528690 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.528611 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "860255e6-bcd3-4840-b625-f3f4f6af2502" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:21:46.528690 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.528651 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "860255e6-bcd3-4840-b625-f3f4f6af2502" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:21:46.528690 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.528668 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "860255e6-bcd3-4840-b625-f3f4f6af2502" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:21:46.537207 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.537180 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/860255e6-bcd3-4840-b625-f3f4f6af2502-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "860255e6-bcd3-4840-b625-f3f4f6af2502" (UID: "860255e6-bcd3-4840-b625-f3f4f6af2502"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:21:46.626936 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.626893 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/860255e6-bcd3-4840-b625-f3f4f6af2502-ca-trust-extracted\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:46.626936 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.626928 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:46.626936 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.626939 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-image-registry-private-configuration\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:46.626936 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.626948 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-bound-sa-token\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:46.627205 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.626958 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/860255e6-bcd3-4840-b625-f3f4f6af2502-installation-pull-secrets\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:46.627205 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.626968 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fnd8\" (UniqueName: \"kubernetes.io/projected/860255e6-bcd3-4840-b625-f3f4f6af2502-kube-api-access-2fnd8\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:46.627205 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.626978 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-trusted-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:46.627205 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:46.626986 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/860255e6-bcd3-4840-b625-f3f4f6af2502-registry-certificates\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:21:47.045553 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.045515 2579 generic.go:356] "Generic (PLEG): container finished" podID="860255e6-bcd3-4840-b625-f3f4f6af2502" containerID="ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d" exitCode=0 Jul 16 17:21:47.045727 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.045574 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" Jul 16 17:21:47.045727 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.045599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" event={"ID":"860255e6-bcd3-4840-b625-f3f4f6af2502","Type":"ContainerDied","Data":"ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d"} Jul 16 17:21:47.045727 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.045667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6544cd8c58-2wghd" event={"ID":"860255e6-bcd3-4840-b625-f3f4f6af2502","Type":"ContainerDied","Data":"2a15f1c38a42e56ccd4237b9b0d42ac3229507be17e0fbc67229353d40c1887a"} Jul 16 17:21:47.045727 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.045687 2579 scope.go:117] "RemoveContainer" containerID="ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d" Jul 16 17:21:47.054358 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.054340 2579 scope.go:117] "RemoveContainer" containerID="ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d" Jul 16 17:21:47.054611 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:21:47.054591 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d\": container with ID starting with ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d not found: ID does not exist" containerID="ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d" Jul 16 17:21:47.054660 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.054621 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d"} err="failed to get container status \"ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d\": rpc error: code = NotFound desc = could not find container \"ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d\": container with ID starting with ea20c6763ce34268b04cc45c753b8b8a7545ca5830ea4c7eaf0a3916bdcd592d not found: ID does not exist" Jul 16 17:21:47.066042 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.066014 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6544cd8c58-2wghd"] Jul 16 17:21:47.069355 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.069334 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6544cd8c58-2wghd"] Jul 16 17:21:47.219103 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.219071 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="860255e6-bcd3-4840-b625-f3f4f6af2502" path="/var/lib/kubelet/pods/860255e6-bcd3-4840-b625-f3f4f6af2502/volumes" Jul 16 17:21:47.446518 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.446472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:47.507333 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:47.507300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:54.077851 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:54.077743 2579 generic.go:356] "Generic (PLEG): container finished" podID="d96ee708-7baf-4168-b489-c57038cf04ca" containerID="15c25d1f3c8d1f625c58c3c1d93282de67ccc31e914c8038e18166bebaaabde8" exitCode=0 Jul 16 17:21:54.078238 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:54.077840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" event={"ID":"d96ee708-7baf-4168-b489-c57038cf04ca","Type":"ContainerDied","Data":"15c25d1f3c8d1f625c58c3c1d93282de67ccc31e914c8038e18166bebaaabde8"} Jul 16 17:21:54.078238 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:54.078190 2579 scope.go:117] "RemoveContainer" containerID="15c25d1f3c8d1f625c58c3c1d93282de67ccc31e914c8038e18166bebaaabde8" Jul 16 17:21:55.083394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:55.083356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-lzm4c" event={"ID":"d96ee708-7baf-4168-b489-c57038cf04ca","Type":"ContainerStarted","Data":"7ff029008a0d252bbfb7dddfbf601abc915c3df8da5d18f2505326f247720f8b"} Jul 16 17:21:56.449290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:56.449236 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:21:56.551426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:21:56.551387 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:02.447398 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:02.447357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:02.503764 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:02.503723 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:02.604282 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:02.604239 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d85c94984-tlfpv" podUID="1f6a5ead-b528-4098-a6df-3eb59be87446" containerName="console" containerID="cri-o://31e5a64f05a655cfff0f6a16f2900bec9c9108f033a28eac99b679baae4ff2f8" gracePeriod=15 Jul 16 17:22:03.119136 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.119105 2579 generic.go:356] "Generic (PLEG): container finished" podID="1f6a5ead-b528-4098-a6df-3eb59be87446" containerID="31e5a64f05a655cfff0f6a16f2900bec9c9108f033a28eac99b679baae4ff2f8" exitCode=0 Jul 16 17:22:03.119296 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.119181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d85c94984-tlfpv" event={"ID":"1f6a5ead-b528-4098-a6df-3eb59be87446","Type":"ContainerDied","Data":"31e5a64f05a655cfff0f6a16f2900bec9c9108f033a28eac99b679baae4ff2f8"} Jul 16 17:22:03.399228 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.399145 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:22:03.571954 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.571922 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-oauth-config\") pod \"1f6a5ead-b528-4098-a6df-3eb59be87446\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " Jul 16 17:22:03.572428 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.571994 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqd48\" (UniqueName: \"kubernetes.io/projected/1f6a5ead-b528-4098-a6df-3eb59be87446-kube-api-access-wqd48\") pod \"1f6a5ead-b528-4098-a6df-3eb59be87446\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " Jul 16 17:22:03.572428 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.572017 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-service-ca\") pod \"1f6a5ead-b528-4098-a6df-3eb59be87446\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " Jul 16 17:22:03.572428 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.572043 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-serving-cert\") pod \"1f6a5ead-b528-4098-a6df-3eb59be87446\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " Jul 16 17:22:03.572428 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.572069 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-oauth-serving-cert\") pod \"1f6a5ead-b528-4098-a6df-3eb59be87446\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " Jul 16 17:22:03.572428 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.572094 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-console-config\") pod \"1f6a5ead-b528-4098-a6df-3eb59be87446\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " Jul 16 17:22:03.572428 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.572203 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-trusted-ca-bundle\") pod \"1f6a5ead-b528-4098-a6df-3eb59be87446\" (UID: \"1f6a5ead-b528-4098-a6df-3eb59be87446\") " Jul 16 17:22:03.572990 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.572917 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f6a5ead-b528-4098-a6df-3eb59be87446" (UID: "1f6a5ead-b528-4098-a6df-3eb59be87446"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:22:03.575983 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.573087 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-console-config" (OuterVolumeSpecName: "console-config") pod "1f6a5ead-b528-4098-a6df-3eb59be87446" (UID: "1f6a5ead-b528-4098-a6df-3eb59be87446"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:22:03.575983 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.573143 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f6a5ead-b528-4098-a6df-3eb59be87446" (UID: "1f6a5ead-b528-4098-a6df-3eb59be87446"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:22:03.575983 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.573257 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f6a5ead-b528-4098-a6df-3eb59be87446" (UID: "1f6a5ead-b528-4098-a6df-3eb59be87446"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:22:03.575983 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.575387 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f6a5ead-b528-4098-a6df-3eb59be87446" (UID: "1f6a5ead-b528-4098-a6df-3eb59be87446"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:22:03.575983 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.575386 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6a5ead-b528-4098-a6df-3eb59be87446-kube-api-access-wqd48" (OuterVolumeSpecName: "kube-api-access-wqd48") pod "1f6a5ead-b528-4098-a6df-3eb59be87446" (UID: "1f6a5ead-b528-4098-a6df-3eb59be87446"). InnerVolumeSpecName "kube-api-access-wqd48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:22:03.579559 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.579487 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f6a5ead-b528-4098-a6df-3eb59be87446" (UID: "1f6a5ead-b528-4098-a6df-3eb59be87446"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:22:03.674402 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.674317 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:22:03.674402 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.674352 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-serving-cert\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:22:03.674402 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.674363 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-oauth-serving-cert\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:22:03.674402 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.674371 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-console-config\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:22:03.674402 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.674379 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f6a5ead-b528-4098-a6df-3eb59be87446-trusted-ca-bundle\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:22:03.674402 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.674388 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f6a5ead-b528-4098-a6df-3eb59be87446-console-oauth-config\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:22:03.674402 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:03.674396 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqd48\" (UniqueName: \"kubernetes.io/projected/1f6a5ead-b528-4098-a6df-3eb59be87446-kube-api-access-wqd48\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:22:04.124776 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:04.124750 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d85c94984-tlfpv" Jul 16 17:22:04.124776 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:04.124757 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d85c94984-tlfpv" event={"ID":"1f6a5ead-b528-4098-a6df-3eb59be87446","Type":"ContainerDied","Data":"cbba586c736bc1d59c1ea3c5a2b84b2c567e81db59f65259a1644b9553d56eac"} Jul 16 17:22:04.125026 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:04.124872 2579 scope.go:117] "RemoveContainer" containerID="31e5a64f05a655cfff0f6a16f2900bec9c9108f033a28eac99b679baae4ff2f8" Jul 16 17:22:04.144982 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:04.144954 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d85c94984-tlfpv"] Jul 16 17:22:04.148552 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:04.148531 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d85c94984-tlfpv"] Jul 16 17:22:05.218109 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:05.218074 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f6a5ead-b528-4098-a6df-3eb59be87446" path="/var/lib/kubelet/pods/1f6a5ead-b528-4098-a6df-3eb59be87446/volumes" Jul 16 17:22:12.137097 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:12.137056 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:12.192518 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:12.192479 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:15.268955 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:15.268898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:15.324094 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:15.324051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:27.241875 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:27.241837 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:27.300583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:27.300544 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:31.723903 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:31.723800 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:32.449384 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:32.449337 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:32.771542 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:32.771450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:32.868729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:32.868674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:33.952752 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:33.952722 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:34.088148 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:34.088112 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:34.147588 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:34.147551 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:58.345541 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:58.345502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:22:58.447437 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:22:58.447396 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:25.198065 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:25.197993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:25.945988 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:25.945953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:29.592269 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:29.592229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:29.677991 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:29.677944 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:30.221418 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:30.221379 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:30.338356 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:30.338318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:30.776874 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:30.776811 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:30.877064 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:30.877021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:32.596217 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:32.596183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:33.176792 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:33.176747 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:35.555908 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:35.555867 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:35.658524 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:35.658469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:41.552042 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:41.551995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:41.649974 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:41.649939 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:41.965261 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:41.965223 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:48.474954 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:48.474915 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:48.579871 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:48.579840 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:50.634549 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:50.634514 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:52.880988 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:52.880941 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:23:52.981183 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:23:52.981146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:03.408940 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:03.408902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:03.543925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:03.543883 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:03.982246 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:03.982204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:04.273986 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.273903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:04.384904 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.384872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:04.426326 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426290 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4"] Jul 16 17:24:04.426717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426686 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de0d20d5-de0d-4c23-b1c1-01d77d940101" containerName="registry" Jul 16 17:24:04.426717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426700 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="de0d20d5-de0d-4c23-b1c1-01d77d940101" containerName="registry" Jul 16 17:24:04.426717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426709 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="860255e6-bcd3-4840-b625-f3f4f6af2502" containerName="registry" Jul 16 17:24:04.426717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426714 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="860255e6-bcd3-4840-b625-f3f4f6af2502" containerName="registry" Jul 16 17:24:04.426717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426720 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62e63f6a-105a-401d-a50b-aafd1457189e" containerName="console" Jul 16 17:24:04.426905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426725 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62e63f6a-105a-401d-a50b-aafd1457189e" containerName="console" Jul 16 17:24:04.426905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426733 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6a5ead-b528-4098-a6df-3eb59be87446" containerName="console" Jul 16 17:24:04.426905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426739 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6a5ead-b528-4098-a6df-3eb59be87446" containerName="console" Jul 16 17:24:04.426905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426801 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="de0d20d5-de0d-4c23-b1c1-01d77d940101" containerName="registry" Jul 16 17:24:04.426905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426808 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62e63f6a-105a-401d-a50b-aafd1457189e" containerName="console" Jul 16 17:24:04.426905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426830 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6a5ead-b528-4098-a6df-3eb59be87446" containerName="console" Jul 16 17:24:04.426905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.426839 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="860255e6-bcd3-4840-b625-f3f4f6af2502" containerName="registry" Jul 16 17:24:04.429847 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.429808 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.433844 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.433801 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 17:24:04.433984 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.433805 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 17:24:04.433984 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.433885 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 17:24:04.433984 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.433945 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mkfx2\"" Jul 16 17:24:04.434173 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.434159 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 17:24:04.451432 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.451391 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4"] Jul 16 17:24:04.560061 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.559965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93d99b1a-3b20-45a2-b312-80265eb856ed-manifests\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.560061 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.560023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93d99b1a-3b20-45a2-b312-80265eb856ed-tmp\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.560061 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.560046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlt92\" (UniqueName: \"kubernetes.io/projected/93d99b1a-3b20-45a2-b312-80265eb856ed-kube-api-access-tlt92\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.560285 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.560095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93d99b1a-3b20-45a2-b312-80265eb856ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.560285 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.560123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93d99b1a-3b20-45a2-b312-80265eb856ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.580941 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.580907 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:04.661260 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.661226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93d99b1a-3b20-45a2-b312-80265eb856ed-tmp\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.661260 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.661261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlt92\" (UniqueName: \"kubernetes.io/projected/93d99b1a-3b20-45a2-b312-80265eb856ed-kube-api-access-tlt92\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.661500 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.661294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93d99b1a-3b20-45a2-b312-80265eb856ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.661500 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.661414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93d99b1a-3b20-45a2-b312-80265eb856ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.661578 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.661517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93d99b1a-3b20-45a2-b312-80265eb856ed-manifests\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.661856 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.661803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93d99b1a-3b20-45a2-b312-80265eb856ed-manifests\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.663672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.663650 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93d99b1a-3b20-45a2-b312-80265eb856ed-tmp\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.663751 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.663729 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93d99b1a-3b20-45a2-b312-80265eb856ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.664010 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.663990 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93d99b1a-3b20-45a2-b312-80265eb856ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.669306 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.669281 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlt92\" (UniqueName: \"kubernetes.io/projected/93d99b1a-3b20-45a2-b312-80265eb856ed-kube-api-access-tlt92\") pod \"opendatahub-operator-controller-manager-875d49b9b-j8gh4\" (UID: \"93d99b1a-3b20-45a2-b312-80265eb856ed\") " pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.677267 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.677240 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:04.740465 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.740424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:04.778890 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.778856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:04.846057 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.846012 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:04.877772 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.877745 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4"] Jul 16 17:24:04.879699 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:24:04.879659 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d99b1a_3b20_45a2_b312_80265eb856ed.slice/crio-26eb8e9cfb4a918684c838958f1144a9b5228e0459063a37a6f5edc0c17c0abf WatchSource:0}: Error finding container 26eb8e9cfb4a918684c838958f1144a9b5228e0459063a37a6f5edc0c17c0abf: Status 404 returned error can't find the container with id 26eb8e9cfb4a918684c838958f1144a9b5228e0459063a37a6f5edc0c17c0abf Jul 16 17:24:04.925483 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:04.925453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:05.049500 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:05.049463 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:05.144127 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:05.144091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:05.607279 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:05.607183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" event={"ID":"93d99b1a-3b20-45a2-b312-80265eb856ed","Type":"ContainerStarted","Data":"26eb8e9cfb4a918684c838958f1144a9b5228e0459063a37a6f5edc0c17c0abf"} Jul 16 17:24:08.622831 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:08.622791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" event={"ID":"93d99b1a-3b20-45a2-b312-80265eb856ed","Type":"ContainerStarted","Data":"3654c39f1d560c469ecfa0e8c5a859461182eaef7727527c241822d3754a635d"} Jul 16 17:24:09.628733 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:09.628696 2579 generic.go:356] "Generic (PLEG): container finished" podID="93d99b1a-3b20-45a2-b312-80265eb856ed" containerID="3654c39f1d560c469ecfa0e8c5a859461182eaef7727527c241822d3754a635d" exitCode=0 Jul 16 17:24:09.629125 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:09.628781 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" event={"ID":"93d99b1a-3b20-45a2-b312-80265eb856ed","Type":"ContainerDied","Data":"3654c39f1d560c469ecfa0e8c5a859461182eaef7727527c241822d3754a635d"} Jul 16 17:24:10.634464 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:10.634419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" event={"ID":"93d99b1a-3b20-45a2-b312-80265eb856ed","Type":"ContainerStarted","Data":"32482971c23b05689b5a7bab563428fa100dce61bc02f90000cc2b8cdccb51a9"} Jul 16 17:24:10.634877 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:10.634542 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:10.655178 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:10.655107 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" podStartSLOduration=1.887881495 podStartE2EDuration="6.655087299s" totalImagesPullingTime="3.677941886s" totalInitContainerRuntime="1.089263918s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:24:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:24:10.653512879 +0000 UTC m=+273.974729043" watchObservedRunningTime="2026-07-16 17:24:10.655087299 +0000 UTC m=+273.976303463" Jul 16 17:24:20.820596 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:20.820552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:20.892899 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:20.892866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:21.641099 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:21.641067 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-875d49b9b-j8gh4" Jul 16 17:24:23.638692 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:23.638652 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:23.753750 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:23.753710 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:24.250361 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.250322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:24.314588 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.314549 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v"] Jul 16 17:24:24.324406 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.324377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.326943 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.326920 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 16 17:24:24.330160 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.330138 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 16 17:24:24.337685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.337662 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v"] Jul 16 17:24:24.430752 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.430712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af7905d4-f5a2-4904-a047-084a36671315-tls-certs\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.430960 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.430757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7905d4-f5a2-4904-a047-084a36671315-tmp\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.430960 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.430879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gn59\" (UniqueName: \"kubernetes.io/projected/af7905d4-f5a2-4904-a047-084a36671315-kube-api-access-4gn59\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.505269 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.505178 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:24.531761 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.531726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gn59\" (UniqueName: \"kubernetes.io/projected/af7905d4-f5a2-4904-a047-084a36671315-kube-api-access-4gn59\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.531921 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.531781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af7905d4-f5a2-4904-a047-084a36671315-tls-certs\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.531921 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.531812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7905d4-f5a2-4904-a047-084a36671315-tmp\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.534172 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.534149 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7905d4-f5a2-4904-a047-084a36671315-tmp\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.534390 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.534370 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af7905d4-f5a2-4904-a047-084a36671315-tls-certs\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.583640 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.583609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gn59\" (UniqueName: \"kubernetes.io/projected/af7905d4-f5a2-4904-a047-084a36671315-kube-api-access-4gn59\") pod \"kube-auth-proxy-7f558794c5-qqb8v\" (UID: \"af7905d4-f5a2-4904-a047-084a36671315\") " pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.619166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.619135 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8ffkf"] Jul 16 17:24:24.621533 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.621511 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:24.624909 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.624890 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 16 17:24:24.625158 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.625143 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-t7xdm\"" Jul 16 17:24:24.633825 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.633797 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" Jul 16 17:24:24.643628 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.643603 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8ffkf"] Jul 16 17:24:24.692600 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.692570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:24.733959 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.733927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxz5j\" (UniqueName: \"kubernetes.io/projected/036b64f1-63cb-4011-8b3b-b76452136ec0-kube-api-access-dxz5j\") pod \"odh-model-controller-7998c67dc4-8ffkf\" (UID: \"036b64f1-63cb-4011-8b3b-b76452136ec0\") " pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:24.734101 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.733964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036b64f1-63cb-4011-8b3b-b76452136ec0-cert\") pod \"odh-model-controller-7998c67dc4-8ffkf\" (UID: \"036b64f1-63cb-4011-8b3b-b76452136ec0\") " pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:24.777487 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.777410 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v"] Jul 16 17:24:24.782093 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:24:24.781942 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7905d4_f5a2_4904_a047_084a36671315.slice/crio-5c73b1e24866d9685cd02b7fa0dd557cae50eee3c6e6c384a03c443e69f8a9aa WatchSource:0}: Error finding container 5c73b1e24866d9685cd02b7fa0dd557cae50eee3c6e6c384a03c443e69f8a9aa: Status 404 returned error can't find the container with id 5c73b1e24866d9685cd02b7fa0dd557cae50eee3c6e6c384a03c443e69f8a9aa Jul 16 17:24:24.801729 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.801698 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:24.834995 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.834960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036b64f1-63cb-4011-8b3b-b76452136ec0-cert\") pod \"odh-model-controller-7998c67dc4-8ffkf\" (UID: \"036b64f1-63cb-4011-8b3b-b76452136ec0\") " pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:24.835278 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:24:24.835129 2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 16 17:24:24.835278 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:24:24.835212 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036b64f1-63cb-4011-8b3b-b76452136ec0-cert podName:036b64f1-63cb-4011-8b3b-b76452136ec0 nodeName:}" failed. No retries permitted until 2026-07-16 17:24:25.33519021 +0000 UTC m=+288.656406369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/036b64f1-63cb-4011-8b3b-b76452136ec0-cert") pod "odh-model-controller-7998c67dc4-8ffkf" (UID: "036b64f1-63cb-4011-8b3b-b76452136ec0") : secret "odh-model-controller-webhook-cert" not found Jul 16 17:24:24.835425 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.835282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxz5j\" (UniqueName: \"kubernetes.io/projected/036b64f1-63cb-4011-8b3b-b76452136ec0-kube-api-access-dxz5j\") pod \"odh-model-controller-7998c67dc4-8ffkf\" (UID: \"036b64f1-63cb-4011-8b3b-b76452136ec0\") " pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:24.849372 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.849335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxz5j\" (UniqueName: \"kubernetes.io/projected/036b64f1-63cb-4011-8b3b-b76452136ec0-kube-api-access-dxz5j\") pod \"odh-model-controller-7998c67dc4-8ffkf\" (UID: \"036b64f1-63cb-4011-8b3b-b76452136ec0\") " pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:24.900895 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:24.900862 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:25.003796 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.003754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:25.340520 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.340470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036b64f1-63cb-4011-8b3b-b76452136ec0-cert\") pod \"odh-model-controller-7998c67dc4-8ffkf\" (UID: \"036b64f1-63cb-4011-8b3b-b76452136ec0\") " pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:25.342964 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.342936 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036b64f1-63cb-4011-8b3b-b76452136ec0-cert\") pod \"odh-model-controller-7998c67dc4-8ffkf\" (UID: \"036b64f1-63cb-4011-8b3b-b76452136ec0\") " pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:25.531351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.531315 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:25.684396 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.684362 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8ffkf"] Jul 16 17:24:25.688327 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:24:25.688299 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036b64f1_63cb_4011_8b3b_b76452136ec0.slice/crio-f71fd83a3ad0fedd566bc07fc04c4c31c31c4df4788a4f06db0a72068c93670a WatchSource:0}: Error finding container f71fd83a3ad0fedd566bc07fc04c4c31c31c4df4788a4f06db0a72068c93670a: Status 404 returned error can't find the container with id f71fd83a3ad0fedd566bc07fc04c4c31c31c4df4788a4f06db0a72068c93670a Jul 16 17:24:25.699580 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.699527 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" event={"ID":"af7905d4-f5a2-4904-a047-084a36671315","Type":"ContainerStarted","Data":"5c73b1e24866d9685cd02b7fa0dd557cae50eee3c6e6c384a03c443e69f8a9aa"} Jul 16 17:24:25.700879 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.700795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" event={"ID":"036b64f1-63cb-4011-8b3b-b76452136ec0","Type":"ContainerStarted","Data":"f71fd83a3ad0fedd566bc07fc04c4c31c31c4df4788a4f06db0a72068c93670a"} Jul 16 17:24:25.803267 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.803229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:25.806364 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.806327 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qb2gz"] Jul 16 17:24:25.810030 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.810004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:25.812481 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.812456 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mxd6t\"" Jul 16 17:24:25.812619 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.812456 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 16 17:24:25.821168 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.821033 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qb2gz"] Jul 16 17:24:25.845139 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.845037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mgx2\" (UniqueName: \"kubernetes.io/projected/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-kube-api-access-8mgx2\") pod \"model-serving-api-54d89bd5fc-qb2gz\" (UID: \"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:25.845139 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.845092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-tls-certs\") pod \"model-serving-api-54d89bd5fc-qb2gz\" (UID: \"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:25.946304 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.946263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mgx2\" (UniqueName: \"kubernetes.io/projected/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-kube-api-access-8mgx2\") pod \"model-serving-api-54d89bd5fc-qb2gz\" (UID: \"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:25.946492 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.946323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-tls-certs\") pod \"model-serving-api-54d89bd5fc-qb2gz\" (UID: \"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:25.946492 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:24:25.946472 2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 16 17:24:25.946620 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:24:25.946548 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-tls-certs podName:4d1548ad-ff25-40cc-b0e8-dd83b3cebe14 nodeName:}" failed. No retries permitted until 2026-07-16 17:24:26.446526204 +0000 UTC m=+289.767742347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-tls-certs") pod "model-serving-api-54d89bd5fc-qb2gz" (UID: "4d1548ad-ff25-40cc-b0e8-dd83b3cebe14") : secret "model-serving-api-tls" not found Jul 16 17:24:25.967097 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:25.967064 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mgx2\" (UniqueName: \"kubernetes.io/projected/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-kube-api-access-8mgx2\") pod \"model-serving-api-54d89bd5fc-qb2gz\" (UID: \"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:26.107738 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.107653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:26.116389 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.116359 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv"] Jul 16 17:24:26.119293 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.119270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.122568 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.122506 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 17:24:26.122568 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.122525 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 17:24:26.122840 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.122618 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 17:24:26.122920 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.122858 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p2dfg\"" Jul 16 17:24:26.123454 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.123434 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 17:24:26.134909 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.134881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv"] Jul 16 17:24:26.148642 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.148617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-cacerts\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.148770 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.148656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdl9m\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-kube-api-access-vdl9m\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.148770 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.148703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.148770 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.148742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.148943 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.148795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-token\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.148943 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.148842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.148943 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.148879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/076b9378-4c1b-4033-9dce-8f4dead21c56-local-certs\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.198810 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.198768 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:26.250080 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.250043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-token\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.250080 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.250084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.250341 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.250134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/076b9378-4c1b-4033-9dce-8f4dead21c56-local-certs\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.250341 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.250229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-cacerts\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.250341 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.250261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdl9m\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-kube-api-access-vdl9m\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.250341 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.250319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.250556 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.250360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.251223 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.251187 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.252679 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.252656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/076b9378-4c1b-4033-9dce-8f4dead21c56-local-certs\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.252758 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.252702 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-cacerts\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.252835 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.252796 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.252956 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.252936 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.258450 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.258421 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-token\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.258782 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.258760 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdl9m\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-kube-api-access-vdl9m\") pod \"istiod-openshift-gateway-7574459656-pdzsv\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.344922 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.344874 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:26.431894 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.431856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:26.452728 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.452605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-tls-certs\") pod \"model-serving-api-54d89bd5fc-qb2gz\" (UID: \"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:26.455568 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.455541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d1548ad-ff25-40cc-b0e8-dd83b3cebe14-tls-certs\") pod \"model-serving-api-54d89bd5fc-qb2gz\" (UID: \"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:26.622450 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.622417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv"] Jul 16 17:24:26.625974 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:24:26.625932 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076b9378_4c1b_4033_9dce_8f4dead21c56.slice/crio-b4e37ed031eed055f2b32f67f8d4cea8a2ee086d5e24725f199e33502b4e46fe WatchSource:0}: Error finding container b4e37ed031eed055f2b32f67f8d4cea8a2ee086d5e24725f199e33502b4e46fe: Status 404 returned error can't find the container with id b4e37ed031eed055f2b32f67f8d4cea8a2ee086d5e24725f199e33502b4e46fe Jul 16 17:24:26.708941 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.708759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" event={"ID":"076b9378-4c1b-4033-9dce-8f4dead21c56","Type":"ContainerStarted","Data":"b4e37ed031eed055f2b32f67f8d4cea8a2ee086d5e24725f199e33502b4e46fe"} Jul 16 17:24:26.724111 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.724035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:26.905000 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:26.904917 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qb2gz"] Jul 16 17:24:26.909876 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:24:26.909838 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1548ad_ff25_40cc_b0e8_dd83b3cebe14.slice/crio-d1ab57b5256605905223ff513b357d6e7e12a779167ccf1974103ce92fb036cb WatchSource:0}: Error finding container d1ab57b5256605905223ff513b357d6e7e12a779167ccf1974103ce92fb036cb: Status 404 returned error can't find the container with id d1ab57b5256605905223ff513b357d6e7e12a779167ccf1974103ce92fb036cb Jul 16 17:24:27.193130 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:27.193087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:27.715091 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:27.715047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" event={"ID":"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14","Type":"ContainerStarted","Data":"d1ab57b5256605905223ff513b357d6e7e12a779167ccf1974103ce92fb036cb"} Jul 16 17:24:29.729517 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:29.729459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" event={"ID":"af7905d4-f5a2-4904-a047-084a36671315","Type":"ContainerStarted","Data":"c2bedf2466d38c719918108eca38de5988ee19f21f86cbe43dbc0c4db62d8800"} Jul 16 17:24:29.732669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:29.731751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" event={"ID":"036b64f1-63cb-4011-8b3b-b76452136ec0","Type":"ContainerStarted","Data":"50fd9ff24bd5dd45f2941d044496f247e1905f5041d84315c1ce37cf70d1e95a"} Jul 16 17:24:29.732669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:29.732621 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:29.746688 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:29.746631 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f558794c5-qqb8v" podStartSLOduration=1.437788559 podStartE2EDuration="5.746610004s" totalImagesPullingTime="4.308821445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:24:29.743171527 +0000 UTC m=+293.064387724" watchObservedRunningTime="2026-07-16 17:24:29.746610004 +0000 UTC m=+293.067826168" Jul 16 17:24:29.761744 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:29.761175 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" podStartSLOduration=2.313407315 podStartE2EDuration="5.761157001s" totalImagesPullingTime="3.447749686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:24:29.759311872 +0000 UTC m=+293.080528071" watchObservedRunningTime="2026-07-16 17:24:29.761157001 +0000 UTC m=+293.082373167" Jul 16 17:24:30.739087 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:30.739041 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" event={"ID":"4d1548ad-ff25-40cc-b0e8-dd83b3cebe14","Type":"ContainerStarted","Data":"03eec2443deadead4332a9d464b479f608bcde8f3ea53da2c57809ec0d7b559b"} Jul 16 17:24:30.739530 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:30.739358 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:30.754495 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:30.754438 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" podStartSLOduration=2.48558568 podStartE2EDuration="5.754417401s" totalImagesPullingTime="3.268831721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:24:30.753650365 +0000 UTC m=+294.074866562" watchObservedRunningTime="2026-07-16 17:24:30.754417401 +0000 UTC m=+294.075633566" Jul 16 17:24:32.301058 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:32.301017 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:24:32.301367 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:32.301090 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:24:32.751195 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:32.751157 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" event={"ID":"076b9378-4c1b-4033-9dce-8f4dead21c56","Type":"ContainerStarted","Data":"eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67"} Jul 16 17:24:32.751404 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:32.751295 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:32.795590 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:32.795534 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" podStartSLOduration=1.123533748 podStartE2EDuration="6.795516493s" totalImagesPullingTime="5.671982745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:24:32.793768254 +0000 UTC m=+296.114984418" watchObservedRunningTime="2026-07-16 17:24:32.795516493 +0000 UTC m=+296.116732656" Jul 16 17:24:33.164992 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:33.164945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:33.327889 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:33.327843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:33.757286 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:33.757255 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-pdzsv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 17:24:33.757466 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:33.757308 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" podUID="076b9378-4c1b-4033-9dce-8f4dead21c56" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 17:24:34.060479 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.060406 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr"] Jul 16 17:24:34.064016 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.063993 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.066752 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.066730 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p2nq4\"" Jul 16 17:24:34.085080 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.085053 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr"] Jul 16 17:24:34.090872 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.090844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:34.124403 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.124403 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.124643 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.124643 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.124643 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29f2q\" (UniqueName: \"kubernetes.io/projected/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-kube-api-access-29f2q\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.124790 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.124790 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.124790 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.124943 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.124811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.219533 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.219499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:34.225575 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.225679 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.225679 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.225679 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.225884 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.225884 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.225884 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.225884 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.225884 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.225799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29f2q\" (UniqueName: \"kubernetes.io/projected/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-kube-api-access-29f2q\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.226118 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.226083 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.226174 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.226119 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.226229 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.226204 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.226321 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.226299 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.226388 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.226328 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.228023 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.227993 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.228324 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.228307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.233041 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.233023 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.233949 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.233930 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29f2q\" (UniqueName: \"kubernetes.io/projected/ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7-kube-api-access-29f2q\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678rjhbr\" (UID: \"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.327334 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.327248 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:34.374363 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.374325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:34.513017 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.512874 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr"] Jul 16 17:24:34.515582 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:24:34.515554 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb9f8a3_f854_4eca_8f47_5ebd2173c1f7.slice/crio-1e68c299d9bb5efaa899e9a18bf785fdd969d4fa5b3cb160be2525b82c11747b WatchSource:0}: Error finding container 1e68c299d9bb5efaa899e9a18bf785fdd969d4fa5b3cb160be2525b82c11747b: Status 404 returned error can't find the container with id 1e68c299d9bb5efaa899e9a18bf785fdd969d4fa5b3cb160be2525b82c11747b Jul 16 17:24:34.760874 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:34.760841 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" event={"ID":"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7","Type":"ContainerStarted","Data":"1e68c299d9bb5efaa899e9a18bf785fdd969d4fa5b3cb160be2525b82c11747b"} Jul 16 17:24:35.699225 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:35.699141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:35.830201 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:35.830156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:35.932791 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:35.932751 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:36.393709 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:36.393649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:36.756727 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:36.756642 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:37.042449 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.042352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:37.162002 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.161975 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:24:37.162183 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.162015 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:24:37.165433 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.165291 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:24:37.165433 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.165355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:24:37.186049 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.172524 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:37.186049 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.172659 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 17:24:37.206644 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.206613 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:24:37.206716 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.206680 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:24:37.206716 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.206705 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:24:37.777054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.777014 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" event={"ID":"ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7","Type":"ContainerStarted","Data":"e560aa4725816fe0e269f70d82051f0bdb0138508d531ed941a77fcd96381d9a"} Jul 16 17:24:37.831297 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:37.831241 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" podStartSLOduration=1.142502135 podStartE2EDuration="3.831224886s" totalImagesPullingTime="2.688722751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:24:37.828481434 +0000 UTC m=+301.149697619" watchObservedRunningTime="2026-07-16 17:24:37.831224886 +0000 UTC m=+301.152441099" Jul 16 17:24:38.065270 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.065180 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv"] Jul 16 17:24:38.065426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.065376 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" podUID="076b9378-4c1b-4033-9dce-8f4dead21c56" containerName="discovery" containerID="cri-o://eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67" gracePeriod=30 Jul 16 17:24:38.310607 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.310584 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:38.368576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.368546 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-dns-cert\") pod \"076b9378-4c1b-4033-9dce-8f4dead21c56\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " Jul 16 17:24:38.368774 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.368611 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdl9m\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-kube-api-access-vdl9m\") pod \"076b9378-4c1b-4033-9dce-8f4dead21c56\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " Jul 16 17:24:38.368843 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.368781 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-cacerts\") pod \"076b9378-4c1b-4033-9dce-8f4dead21c56\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " Jul 16 17:24:38.368890 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.368860 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-token\") pod \"076b9378-4c1b-4033-9dce-8f4dead21c56\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " Jul 16 17:24:38.368933 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.368901 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-ca-configmap\") pod \"076b9378-4c1b-4033-9dce-8f4dead21c56\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " Jul 16 17:24:38.368933 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.368927 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-kubeconfig\") pod \"076b9378-4c1b-4033-9dce-8f4dead21c56\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " Jul 16 17:24:38.369019 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.368954 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/076b9378-4c1b-4033-9dce-8f4dead21c56-local-certs\") pod \"076b9378-4c1b-4033-9dce-8f4dead21c56\" (UID: \"076b9378-4c1b-4033-9dce-8f4dead21c56\") " Jul 16 17:24:38.369404 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.369357 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "076b9378-4c1b-4033-9dce-8f4dead21c56" (UID: "076b9378-4c1b-4033-9dce-8f4dead21c56"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:24:38.371349 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.371317 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-kube-api-access-vdl9m" (OuterVolumeSpecName: "kube-api-access-vdl9m") pod "076b9378-4c1b-4033-9dce-8f4dead21c56" (UID: "076b9378-4c1b-4033-9dce-8f4dead21c56"). InnerVolumeSpecName "kube-api-access-vdl9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:24:38.371670 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.371635 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-cacerts" (OuterVolumeSpecName: "cacerts") pod "076b9378-4c1b-4033-9dce-8f4dead21c56" (UID: "076b9378-4c1b-4033-9dce-8f4dead21c56"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:24:38.371760 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.371692 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "076b9378-4c1b-4033-9dce-8f4dead21c56" (UID: "076b9378-4c1b-4033-9dce-8f4dead21c56"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:24:38.371760 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.371700 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/076b9378-4c1b-4033-9dce-8f4dead21c56-local-certs" (OuterVolumeSpecName: "local-certs") pod "076b9378-4c1b-4033-9dce-8f4dead21c56" (UID: "076b9378-4c1b-4033-9dce-8f4dead21c56"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:24:38.371760 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.371709 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "076b9378-4c1b-4033-9dce-8f4dead21c56" (UID: "076b9378-4c1b-4033-9dce-8f4dead21c56"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:24:38.371760 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.371692 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-token" (OuterVolumeSpecName: "istio-token") pod "076b9378-4c1b-4033-9dce-8f4dead21c56" (UID: "076b9378-4c1b-4033-9dce-8f4dead21c56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:24:38.374869 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.374847 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:38.380268 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.380245 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:38.470420 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.470385 2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-ca-configmap\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:24:38.470420 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.470416 2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-kubeconfig\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:24:38.470420 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.470426 2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/076b9378-4c1b-4033-9dce-8f4dead21c56-local-certs\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:24:38.470686 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.470436 2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-csr-dns-cert\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:24:38.470686 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.470450 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdl9m\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-kube-api-access-vdl9m\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:24:38.470686 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.470461 2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/076b9378-4c1b-4033-9dce-8f4dead21c56-cacerts\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:24:38.470686 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.470469 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/076b9378-4c1b-4033-9dce-8f4dead21c56-istio-token\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:24:38.782970 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.782881 2579 generic.go:356] "Generic (PLEG): container finished" podID="076b9378-4c1b-4033-9dce-8f4dead21c56" containerID="eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67" exitCode=0 Jul 16 17:24:38.782970 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.782934 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" Jul 16 17:24:38.783438 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.782965 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" event={"ID":"076b9378-4c1b-4033-9dce-8f4dead21c56","Type":"ContainerDied","Data":"eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67"} Jul 16 17:24:38.783438 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.783013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv" event={"ID":"076b9378-4c1b-4033-9dce-8f4dead21c56","Type":"ContainerDied","Data":"b4e37ed031eed055f2b32f67f8d4cea8a2ee086d5e24725f199e33502b4e46fe"} Jul 16 17:24:38.783438 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.783034 2579 scope.go:117] "RemoveContainer" containerID="eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67" Jul 16 17:24:38.783438 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.783401 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:38.784539 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.784526 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678rjhbr" Jul 16 17:24:38.792365 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.792349 2579 scope.go:117] "RemoveContainer" containerID="eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67" Jul 16 17:24:38.792631 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:24:38.792614 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67\": container with ID starting with eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67 not found: ID does not exist" containerID="eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67" Jul 16 17:24:38.792677 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.792639 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67"} err="failed to get container status \"eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67\": rpc error: code = NotFound desc = could not find container \"eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67\": container with ID starting with eb950e8d66913d73e2184cadf9f39b23aa6babcf58bb98d5ecce7a8a3fd34c67 not found: ID does not exist" Jul 16 17:24:38.823160 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.823129 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv"] Jul 16 17:24:38.833788 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:38.833754 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdzsv"] Jul 16 17:24:39.218397 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:39.218363 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076b9378-4c1b-4033-9dce-8f4dead21c56" path="/var/lib/kubelet/pods/076b9378-4c1b-4033-9dce-8f4dead21c56/volumes" Jul 16 17:24:40.741382 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:40.741343 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-8ffkf" Jul 16 17:24:41.749760 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:41.749730 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gz" Jul 16 17:24:55.011845 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:55.011779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:24:56.316767 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:24:56.316734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:25:25.201386 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.201342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:25:25.300014 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.299975 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:25:25.366787 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.366747 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrpwj"] Jul 16 17:25:25.367122 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.367109 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076b9378-4c1b-4033-9dce-8f4dead21c56" containerName="discovery" Jul 16 17:25:25.367166 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.367124 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="076b9378-4c1b-4033-9dce-8f4dead21c56" containerName="discovery" Jul 16 17:25:25.367201 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.367183 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="076b9378-4c1b-4033-9dce-8f4dead21c56" containerName="discovery" Jul 16 17:25:25.376383 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.376350 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" Jul 16 17:25:25.379777 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.379747 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 17:25:25.379969 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.379853 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 17:25:25.380522 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.380494 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qz2z6\"" Jul 16 17:25:25.380653 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.380568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrpwj"] Jul 16 17:25:25.434990 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.434957 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:25:25.474973 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.474889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txkq\" (UniqueName: \"kubernetes.io/projected/1ea9983c-e123-406b-a88a-4f8388aa8783-kube-api-access-7txkq\") pod \"kuadrant-operator-catalog-wrpwj\" (UID: \"1ea9983c-e123-406b-a88a-4f8388aa8783\") " pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" Jul 16 17:25:25.575798 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.575748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7txkq\" (UniqueName: \"kubernetes.io/projected/1ea9983c-e123-406b-a88a-4f8388aa8783-kube-api-access-7txkq\") pod \"kuadrant-operator-catalog-wrpwj\" (UID: \"1ea9983c-e123-406b-a88a-4f8388aa8783\") " pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" Jul 16 17:25:25.589271 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.589247 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txkq\" (UniqueName: \"kubernetes.io/projected/1ea9983c-e123-406b-a88a-4f8388aa8783-kube-api-access-7txkq\") pod \"kuadrant-operator-catalog-wrpwj\" (UID: \"1ea9983c-e123-406b-a88a-4f8388aa8783\") " pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" Jul 16 17:25:25.688250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.688213 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" Jul 16 17:25:25.722939 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.722897 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrpwj"] Jul 16 17:25:25.826124 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.826098 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrpwj"] Jul 16 17:25:25.828725 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:25:25.828693 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea9983c_e123_406b_a88a_4f8388aa8783.slice/crio-71bfae423020078b6f506b38ca03781b3e87d95b78d31c61467d7573e465a179 WatchSource:0}: Error finding container 71bfae423020078b6f506b38ca03781b3e87d95b78d31c61467d7573e465a179: Status 404 returned error can't find the container with id 71bfae423020078b6f506b38ca03781b3e87d95b78d31c61467d7573e465a179 Jul 16 17:25:25.830108 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.830089 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:25:25.932117 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.932083 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7m6dv"] Jul 16 17:25:25.941005 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.940971 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:25.943201 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.943168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7m6dv"] Jul 16 17:25:25.979148 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:25.979110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7jvw\" (UniqueName: \"kubernetes.io/projected/a4c05c32-b18d-4711-b43e-1c82a0ce2527-kube-api-access-d7jvw\") pod \"kuadrant-operator-catalog-7m6dv\" (UID: \"a4c05c32-b18d-4711-b43e-1c82a0ce2527\") " pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:26.002343 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:26.002271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" event={"ID":"1ea9983c-e123-406b-a88a-4f8388aa8783","Type":"ContainerStarted","Data":"71bfae423020078b6f506b38ca03781b3e87d95b78d31c61467d7573e465a179"} Jul 16 17:25:26.080585 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:26.080547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7jvw\" (UniqueName: \"kubernetes.io/projected/a4c05c32-b18d-4711-b43e-1c82a0ce2527-kube-api-access-d7jvw\") pod \"kuadrant-operator-catalog-7m6dv\" (UID: \"a4c05c32-b18d-4711-b43e-1c82a0ce2527\") " pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:26.089269 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:26.089238 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7jvw\" (UniqueName: \"kubernetes.io/projected/a4c05c32-b18d-4711-b43e-1c82a0ce2527-kube-api-access-d7jvw\") pod \"kuadrant-operator-catalog-7m6dv\" (UID: \"a4c05c32-b18d-4711-b43e-1c82a0ce2527\") " pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:26.251512 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:26.251475 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:26.382128 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:26.382095 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7m6dv"] Jul 16 17:25:26.385418 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:25:26.385388 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c05c32_b18d_4711_b43e_1c82a0ce2527.slice/crio-518922d8262086b53fb549d4bf875d67967122f312a174e8955b5cf093daa001 WatchSource:0}: Error finding container 518922d8262086b53fb549d4bf875d67967122f312a174e8955b5cf093daa001: Status 404 returned error can't find the container with id 518922d8262086b53fb549d4bf875d67967122f312a174e8955b5cf093daa001 Jul 16 17:25:27.008489 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:27.008453 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" event={"ID":"a4c05c32-b18d-4711-b43e-1c82a0ce2527","Type":"ContainerStarted","Data":"518922d8262086b53fb549d4bf875d67967122f312a174e8955b5cf093daa001"} Jul 16 17:25:29.020893 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.020850 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" event={"ID":"1ea9983c-e123-406b-a88a-4f8388aa8783","Type":"ContainerStarted","Data":"bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9"} Jul 16 17:25:29.021327 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.020903 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" podUID="1ea9983c-e123-406b-a88a-4f8388aa8783" containerName="registry-server" containerID="cri-o://bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9" gracePeriod=2 Jul 16 17:25:29.022418 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.022389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" event={"ID":"a4c05c32-b18d-4711-b43e-1c82a0ce2527","Type":"ContainerStarted","Data":"5f3c37f99ae86b4b52517c011871be6de681947582d1156b73689b0213732775"} Jul 16 17:25:29.036866 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.036808 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" podStartSLOduration=1.7626966400000001 podStartE2EDuration="4.03679266s" totalImagesPullingTime="2.27409602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:25:29.035286274 +0000 UTC m=+352.356502438" watchObservedRunningTime="2026-07-16 17:25:29.03679266 +0000 UTC m=+352.358008833" Jul 16 17:25:29.050302 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.050258 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" podStartSLOduration=2.320568401 podStartE2EDuration="4.050242926s" totalImagesPullingTime="1.729674525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:25:29.048732282 +0000 UTC m=+352.369948447" watchObservedRunningTime="2026-07-16 17:25:29.050242926 +0000 UTC m=+352.371459090" Jul 16 17:25:29.269136 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.269108 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" Jul 16 17:25:29.410761 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.410728 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7txkq\" (UniqueName: \"kubernetes.io/projected/1ea9983c-e123-406b-a88a-4f8388aa8783-kube-api-access-7txkq\") pod \"1ea9983c-e123-406b-a88a-4f8388aa8783\" (UID: \"1ea9983c-e123-406b-a88a-4f8388aa8783\") " Jul 16 17:25:29.412960 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.412932 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea9983c-e123-406b-a88a-4f8388aa8783-kube-api-access-7txkq" (OuterVolumeSpecName: "kube-api-access-7txkq") pod "1ea9983c-e123-406b-a88a-4f8388aa8783" (UID: "1ea9983c-e123-406b-a88a-4f8388aa8783"). InnerVolumeSpecName "kube-api-access-7txkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:25:29.511603 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:29.511565 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7txkq\" (UniqueName: \"kubernetes.io/projected/1ea9983c-e123-406b-a88a-4f8388aa8783-kube-api-access-7txkq\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:25:30.028361 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.028330 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea9983c-e123-406b-a88a-4f8388aa8783" containerID="bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9" exitCode=0 Jul 16 17:25:30.028775 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.028373 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" Jul 16 17:25:30.028775 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.028418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" event={"ID":"1ea9983c-e123-406b-a88a-4f8388aa8783","Type":"ContainerDied","Data":"bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9"} Jul 16 17:25:30.028775 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.028474 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrpwj" event={"ID":"1ea9983c-e123-406b-a88a-4f8388aa8783","Type":"ContainerDied","Data":"71bfae423020078b6f506b38ca03781b3e87d95b78d31c61467d7573e465a179"} Jul 16 17:25:30.028775 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.028500 2579 scope.go:117] "RemoveContainer" containerID="bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9" Jul 16 17:25:30.037720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.037703 2579 scope.go:117] "RemoveContainer" containerID="bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9" Jul 16 17:25:30.038000 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:25:30.037981 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9\": container with ID starting with bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9 not found: ID does not exist" containerID="bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9" Jul 16 17:25:30.038055 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.038011 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9"} err="failed to get container status \"bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9\": rpc error: code = NotFound desc = could not find container \"bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9\": container with ID starting with bfcc84129505ab470b860fef4d0b21b2caf764a2c886d32f0f1194da408c3eb9 not found: ID does not exist" Jul 16 17:25:30.047302 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.047279 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrpwj"] Jul 16 17:25:30.051309 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:30.051288 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrpwj"] Jul 16 17:25:31.224274 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:31.224243 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea9983c-e123-406b-a88a-4f8388aa8783" path="/var/lib/kubelet/pods/1ea9983c-e123-406b-a88a-4f8388aa8783/volumes" Jul 16 17:25:36.252685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:36.252649 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:36.253137 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:36.252709 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:36.275388 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:36.275363 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:37.084534 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:37.084507 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7m6dv" Jul 16 17:25:40.883903 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:40.883866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:25:40.983484 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:40.983434 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:25:53.487431 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:53.487398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:25:54.073521 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:54.073482 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:25:57.542888 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.542855 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dfrph"] Jul 16 17:25:57.543375 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.543191 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea9983c-e123-406b-a88a-4f8388aa8783" containerName="registry-server" Jul 16 17:25:57.543375 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.543203 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea9983c-e123-406b-a88a-4f8388aa8783" containerName="registry-server" Jul 16 17:25:57.543375 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.543280 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea9983c-e123-406b-a88a-4f8388aa8783" containerName="registry-server" Jul 16 17:25:57.549340 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.549320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" Jul 16 17:25:57.552062 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.552044 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gtmjb\"" Jul 16 17:25:57.557645 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.557622 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dfrph"] Jul 16 17:25:57.566071 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.566043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtrlz\" (UniqueName: \"kubernetes.io/projected/95d38b55-08f6-40b6-b38d-9a4d59f15273-kube-api-access-gtrlz\") pod \"authorino-operator-75cc8d5cb7-dfrph\" (UID: \"95d38b55-08f6-40b6-b38d-9a4d59f15273\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" Jul 16 17:25:57.667350 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.667314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtrlz\" (UniqueName: \"kubernetes.io/projected/95d38b55-08f6-40b6-b38d-9a4d59f15273-kube-api-access-gtrlz\") pod \"authorino-operator-75cc8d5cb7-dfrph\" (UID: \"95d38b55-08f6-40b6-b38d-9a4d59f15273\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" Jul 16 17:25:57.679082 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.679048 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtrlz\" (UniqueName: \"kubernetes.io/projected/95d38b55-08f6-40b6-b38d-9a4d59f15273-kube-api-access-gtrlz\") pod \"authorino-operator-75cc8d5cb7-dfrph\" (UID: \"95d38b55-08f6-40b6-b38d-9a4d59f15273\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" Jul 16 17:25:57.860448 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:57.860338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" Jul 16 17:25:58.006912 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:58.006881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dfrph"] Jul 16 17:25:58.009603 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:25:58.009576 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d38b55_08f6_40b6_b38d_9a4d59f15273.slice/crio-bc1b503f42ea60f31635adfd4915a5cf3dee2fe0b35572c7be107eb20a00da96 WatchSource:0}: Error finding container bc1b503f42ea60f31635adfd4915a5cf3dee2fe0b35572c7be107eb20a00da96: Status 404 returned error can't find the container with id bc1b503f42ea60f31635adfd4915a5cf3dee2fe0b35572c7be107eb20a00da96 Jul 16 17:25:58.158890 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:25:58.158851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" event={"ID":"95d38b55-08f6-40b6-b38d-9a4d59f15273","Type":"ContainerStarted","Data":"bc1b503f42ea60f31635adfd4915a5cf3dee2fe0b35572c7be107eb20a00da96"} Jul 16 17:26:00.149638 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:00.149590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:00.774883 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:00.774843 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr"] Jul 16 17:26:00.778692 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:00.778670 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:00.780866 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:00.780838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wx6cs\"" Jul 16 17:26:00.790399 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:00.790374 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr"] Jul 16 17:26:00.893330 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:00.893294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxck\" (UniqueName: \"kubernetes.io/projected/c4429ac8-39f8-4a60-b469-eb42ff17980d-kube-api-access-qwxck\") pod \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" (UID: \"c4429ac8-39f8-4a60-b469-eb42ff17980d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:00.980906 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:00.980869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:00.994866 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:00.994829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxck\" (UniqueName: \"kubernetes.io/projected/c4429ac8-39f8-4a60-b469-eb42ff17980d-kube-api-access-qwxck\") pod \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" (UID: \"c4429ac8-39f8-4a60-b469-eb42ff17980d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:01.005306 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:01.005276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxck\" (UniqueName: \"kubernetes.io/projected/c4429ac8-39f8-4a60-b469-eb42ff17980d-kube-api-access-qwxck\") pod \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" (UID: \"c4429ac8-39f8-4a60-b469-eb42ff17980d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:01.075460 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:01.075433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:01.092605 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:01.092577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:01.176896 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:01.176851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" event={"ID":"95d38b55-08f6-40b6-b38d-9a4d59f15273","Type":"ContainerStarted","Data":"255a9876cdff1c66bceaed90674db3c31c7d35003d08508a800364032c7bf2b6"} Jul 16 17:26:01.177303 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:01.176982 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" Jul 16 17:26:01.208470 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:01.208421 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" podStartSLOduration=1.166493602 podStartE2EDuration="4.208402158s" totalImagesPullingTime="3.041908556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:01.206211089 +0000 UTC m=+384.527427253" watchObservedRunningTime="2026-07-16 17:26:01.208402158 +0000 UTC m=+384.529618322" Jul 16 17:26:01.252837 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:01.252797 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr"] Jul 16 17:26:01.255323 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:26:01.255295 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4429ac8_39f8_4a60_b469_eb42ff17980d.slice/crio-a711d2b7a3bd853da8d67c1a551362757432e882311d318b450e034c6e1dc321 WatchSource:0}: Error finding container a711d2b7a3bd853da8d67c1a551362757432e882311d318b450e034c6e1dc321: Status 404 returned error can't find the container with id a711d2b7a3bd853da8d67c1a551362757432e882311d318b450e034c6e1dc321 Jul 16 17:26:01.502079 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:01.502049 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:02.185836 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:02.185783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" event={"ID":"c4429ac8-39f8-4a60-b469-eb42ff17980d","Type":"ContainerStarted","Data":"a711d2b7a3bd853da8d67c1a551362757432e882311d318b450e034c6e1dc321"} Jul 16 17:26:03.192761 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:03.192732 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" event={"ID":"c4429ac8-39f8-4a60-b469-eb42ff17980d","Type":"ContainerStarted","Data":"8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f"} Jul 16 17:26:03.193177 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:03.192842 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:03.193631 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:03.193606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:03.219762 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:03.219716 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" podStartSLOduration=1.363079286 podStartE2EDuration="3.219700758s" totalImagesPullingTime="1.856621472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:03.217811107 +0000 UTC m=+386.539027289" watchObservedRunningTime="2026-07-16 17:26:03.219700758 +0000 UTC m=+386.540916922" Jul 16 17:26:05.124455 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:05.124410 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:05.872003 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:05.871968 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c"] Jul 16 17:26:05.875557 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:05.875540 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:05.877661 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:05.877640 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lc8q4\"" Jul 16 17:26:05.891425 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:05.891400 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c"] Jul 16 17:26:05.940444 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:05.940415 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fg95\" (UniqueName: \"kubernetes.io/projected/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-kube-api-access-4fg95\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" (UID: \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:05.940619 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:05.940485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" (UID: \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:06.041989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:06.041943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" (UID: \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:06.042175 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:06.042038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fg95\" (UniqueName: \"kubernetes.io/projected/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-kube-api-access-4fg95\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" (UID: \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:06.042351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:06.042330 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" (UID: \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:06.055125 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:06.055093 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fg95\" (UniqueName: \"kubernetes.io/projected/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-kube-api-access-4fg95\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" (UID: \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:06.185430 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:06.185327 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:06.330661 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:06.330629 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c"] Jul 16 17:26:06.332140 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:26:06.332108 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce64ad9d_dd7a_4185_9e26_177ec4cfc4a5.slice/crio-c2c33d2f3025ff8e76c05864b4b5e5c691ef816adc19c03a9f0899dbcb24eb5c WatchSource:0}: Error finding container c2c33d2f3025ff8e76c05864b4b5e5c691ef816adc19c03a9f0899dbcb24eb5c: Status 404 returned error can't find the container with id c2c33d2f3025ff8e76c05864b4b5e5c691ef816adc19c03a9f0899dbcb24eb5c Jul 16 17:26:06.683801 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:06.683763 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:07.219715 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:07.219671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" event={"ID":"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5","Type":"ContainerStarted","Data":"c2c33d2f3025ff8e76c05864b4b5e5c691ef816adc19c03a9f0899dbcb24eb5c"} Jul 16 17:26:07.912244 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:07.912208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:08.364425 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.364384 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn"] Jul 16 17:26:08.367914 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.367896 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" Jul 16 17:26:08.370131 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.370107 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 16 17:26:08.370260 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.370114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vbx9k\"" Jul 16 17:26:08.381989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.381961 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn"] Jul 16 17:26:08.465777 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.465740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l679q\" (UniqueName: \"kubernetes.io/projected/6136f313-4f1b-4657-aff9-2dce758bc163-kube-api-access-l679q\") pod \"dns-operator-controller-manager-864dd78c4c-wrmmn\" (UID: \"6136f313-4f1b-4657-aff9-2dce758bc163\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" Jul 16 17:26:08.567033 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.566996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l679q\" (UniqueName: \"kubernetes.io/projected/6136f313-4f1b-4657-aff9-2dce758bc163-kube-api-access-l679q\") pod \"dns-operator-controller-manager-864dd78c4c-wrmmn\" (UID: \"6136f313-4f1b-4657-aff9-2dce758bc163\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" Jul 16 17:26:08.576007 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.575979 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l679q\" (UniqueName: \"kubernetes.io/projected/6136f313-4f1b-4657-aff9-2dce758bc163-kube-api-access-l679q\") pod \"dns-operator-controller-manager-864dd78c4c-wrmmn\" (UID: \"6136f313-4f1b-4657-aff9-2dce758bc163\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" Jul 16 17:26:08.678889 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.678792 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" Jul 16 17:26:08.826291 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:08.826262 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn"] Jul 16 17:26:08.828531 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:26:08.828498 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6136f313_4f1b_4657_aff9_2dce758bc163.slice/crio-7e77fc62e112d75505b070b7bbaf666b4760ab5e9cde71e4975c300625f94208 WatchSource:0}: Error finding container 7e77fc62e112d75505b070b7bbaf666b4760ab5e9cde71e4975c300625f94208: Status 404 returned error can't find the container with id 7e77fc62e112d75505b070b7bbaf666b4760ab5e9cde71e4975c300625f94208 Jul 16 17:26:09.228220 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:09.228178 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" event={"ID":"6136f313-4f1b-4657-aff9-2dce758bc163","Type":"ContainerStarted","Data":"7e77fc62e112d75505b070b7bbaf666b4760ab5e9cde71e4975c300625f94208"} Jul 16 17:26:09.898736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:09.898695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:09.993448 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:09.993406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:10.284070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:10.283972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:10.345929 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:10.345892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:12.188464 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:12.188432 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfrph" Jul 16 17:26:12.243725 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:12.243686 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" event={"ID":"6136f313-4f1b-4657-aff9-2dce758bc163","Type":"ContainerStarted","Data":"0d04431cc6570111fb50786e96634db4afe2666919186bd6c2459467677d7627"} Jul 16 17:26:12.243917 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:12.243877 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" Jul 16 17:26:12.267286 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:12.267238 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" podStartSLOduration=1.375874097 podStartE2EDuration="4.267219702s" totalImagesPullingTime="2.891345605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:12.264329285 +0000 UTC m=+395.585545495" watchObservedRunningTime="2026-07-16 17:26:12.267219702 +0000 UTC m=+395.588435866" Jul 16 17:26:13.250799 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:13.250760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" event={"ID":"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5","Type":"ContainerStarted","Data":"5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02"} Jul 16 17:26:13.251229 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:13.251028 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:13.275785 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:13.275726 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" podStartSLOduration=1.547376341 podStartE2EDuration="8.2757116s" totalImagesPullingTime="6.728335259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:13.274394027 +0000 UTC m=+396.595610190" watchObservedRunningTime="2026-07-16 17:26:13.2757116 +0000 UTC m=+396.596927863" Jul 16 17:26:13.732544 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:13.732506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:13.819590 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:13.819531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:14.199775 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:14.199749 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:15.970484 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:15.970441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:16.232852 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:16.232749 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:17.093736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:17.093702 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:17.215764 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:17.215729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:22.708183 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:22.708151 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:22.809978 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:22.809943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:23.253451 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:23.253423 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wrmmn" Jul 16 17:26:24.258177 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:24.258150 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:25.646329 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.646292 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx"] Jul 16 17:26:25.649996 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.649975 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:25.661464 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.661436 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx"] Jul 16 17:26:25.826645 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.826592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" (UID: \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:25.826645 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.826646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8lvl\" (UniqueName: \"kubernetes.io/projected/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-kube-api-access-g8lvl\") pod \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" (UID: \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:25.927483 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.927380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" (UID: \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:25.927483 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.927432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8lvl\" (UniqueName: \"kubernetes.io/projected/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-kube-api-access-g8lvl\") pod \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" (UID: \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:25.927778 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.927758 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" (UID: \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:25.936449 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.936418 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8lvl\" (UniqueName: \"kubernetes.io/projected/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-kube-api-access-g8lvl\") pod \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" (UID: \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:25.960432 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:25.960404 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:26.005076 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.005039 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx"] Jul 16 17:26:26.014313 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.014239 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx"] Jul 16 17:26:26.027181 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.025913 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c"] Jul 16 17:26:26.027181 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.026146 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" containerName="manager" containerID="cri-o://5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02" gracePeriod=2 Jul 16 17:26:26.030789 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.030751 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln"] Jul 16 17:26:26.037338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.037312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:26.044110 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.044047 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c"] Jul 16 17:26:26.048222 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.048179 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln"] Jul 16 17:26:26.056099 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.056064 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\": pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.056426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.056405 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9"] Jul 16 17:26:26.056896 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.056808 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" containerName="manager" Jul 16 17:26:26.056896 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.056841 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" containerName="manager" Jul 16 17:26:26.057079 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.056943 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" containerName="manager" Jul 16 17:26:26.060600 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.060580 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr"] Jul 16 17:26:26.060704 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.060686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:26.060756 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.060737 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" containerName="manager" containerID="cri-o://8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f" gracePeriod=2 Jul 16 17:26:26.066741 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.066715 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr"] Jul 16 17:26:26.075862 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.075809 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9"] Jul 16 17:26:26.080415 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.080365 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.081782 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.081749 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.086268 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.086242 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g"] Jul 16 17:26:26.086875 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.086851 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" containerName="manager" Jul 16 17:26:26.086875 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.086873 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" containerName="manager" Jul 16 17:26:26.087024 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.087012 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" containerName="manager" Jul 16 17:26:26.090386 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.090366 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" Jul 16 17:26:26.102436 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.101596 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g"] Jul 16 17:26:26.103134 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.102741 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.112004 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.105095 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.126528 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.126467 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.131914 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.131884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e836dcc-fd69-4f32-9565-627ad0598fd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6nrln\" (UID: \"8e836dcc-fd69-4f32-9565-627ad0598fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:26.132046 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.131922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lc4\" (UniqueName: \"kubernetes.io/projected/8e836dcc-fd69-4f32-9565-627ad0598fd7-kube-api-access-k6lc4\") pod \"kuadrant-operator-controller-manager-55467d9f7-6nrln\" (UID: \"8e836dcc-fd69-4f32-9565-627ad0598fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:26.232514 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.232479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv7hd\" (UniqueName: \"kubernetes.io/projected/efe7bf0f-d35d-40d3-8681-344664f2f0c4-kube-api-access-zv7hd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgwf9\" (UID: \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:26.232720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.232559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e836dcc-fd69-4f32-9565-627ad0598fd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6nrln\" (UID: \"8e836dcc-fd69-4f32-9565-627ad0598fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:26.232720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.232581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lc4\" (UniqueName: \"kubernetes.io/projected/8e836dcc-fd69-4f32-9565-627ad0598fd7-kube-api-access-k6lc4\") pod \"kuadrant-operator-controller-manager-55467d9f7-6nrln\" (UID: \"8e836dcc-fd69-4f32-9565-627ad0598fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:26.232720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.232610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jcsk\" (UniqueName: \"kubernetes.io/projected/a1f95e1f-5e82-41a9-ac39-ddaf67814c24-kube-api-access-6jcsk\") pod \"limitador-operator-controller-manager-859d7b78bd-dp57g\" (UID: \"a1f95e1f-5e82-41a9-ac39-ddaf67814c24\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" Jul 16 17:26:26.232948 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.232752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efe7bf0f-d35d-40d3-8681-344664f2f0c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgwf9\" (UID: \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:26.233092 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.233065 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e836dcc-fd69-4f32-9565-627ad0598fd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6nrln\" (UID: \"8e836dcc-fd69-4f32-9565-627ad0598fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:26.246685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.246651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6lc4\" (UniqueName: \"kubernetes.io/projected/8e836dcc-fd69-4f32-9565-627ad0598fd7-kube-api-access-k6lc4\") pod \"kuadrant-operator-controller-manager-55467d9f7-6nrln\" (UID: \"8e836dcc-fd69-4f32-9565-627ad0598fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:26.285554 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.285513 2579 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 16 17:26:26.285554 ip-10-0-131-79 kubenswrapper[2579]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-grsfx_kuadrant-system_30f6bc0e-90cb-4534-8b2b-fcc797abf7a2_0(81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-grsfx to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43" Netns:"/var/run/netns/abaaa13f-58a9-4a77-ba73-b85f7b5bfcf4" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-grsfx;K8S_POD_INFRA_CONTAINER_ID=81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43;K8S_POD_UID=30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx 81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx 81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:2a [10.132.0.42/23] Jul 16 17:26:26.285554 ip-10-0-131-79 kubenswrapper[2579]: ' Jul 16 17:26:26.285554 ip-10-0-131-79 kubenswrapper[2579]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 16 17:26:26.285554 ip-10-0-131-79 kubenswrapper[2579]: > Jul 16 17:26:26.285744 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.285586 2579 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 16 17:26:26.285744 ip-10-0-131-79 kubenswrapper[2579]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-grsfx_kuadrant-system_30f6bc0e-90cb-4534-8b2b-fcc797abf7a2_0(81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-grsfx to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43" Netns:"/var/run/netns/abaaa13f-58a9-4a77-ba73-b85f7b5bfcf4" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-grsfx;K8S_POD_INFRA_CONTAINER_ID=81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43;K8S_POD_UID=30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx 81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx 81e8fb63322c86c72a00f93f736c56d7b3e9ebeb202848e12429236d5565dd43 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:2a [10.132.0.42/23] Jul 16 17:26:26.285744 ip-10-0-131-79 kubenswrapper[2579]: ' Jul 16 17:26:26.285744 ip-10-0-131-79 kubenswrapper[2579]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 16 17:26:26.285744 ip-10-0-131-79 kubenswrapper[2579]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:26.308094 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.308071 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.309975 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.309946 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.311467 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.311440 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.314441 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.314422 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.314904 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.314876 2579 generic.go:356] "Generic (PLEG): container finished" podID="c4429ac8-39f8-4a60-b469-eb42ff17980d" containerID="8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f" exitCode=0 Jul 16 17:26:26.315015 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.314905 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.315015 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.314963 2579 scope.go:117] "RemoveContainer" containerID="8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f" Jul 16 17:26:26.315983 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.315961 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.316500 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.316481 2579 generic.go:356] "Generic (PLEG): container finished" podID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" containerID="5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02" exitCode=0 Jul 16 17:26:26.316582 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.316514 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.316651 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.316639 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:26.317409 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.317388 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.318710 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.318688 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:26.320079 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.320049 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.321288 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.321265 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.324074 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.324058 2579 scope.go:117] "RemoveContainer" containerID="8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f" Jul 16 17:26:26.324250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.324233 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:26.324333 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.324316 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f\": container with ID starting with 8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f not found: ID does not exist" containerID="8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f" Jul 16 17:26:26.324381 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.324341 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f"} err="failed to get container status \"8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f\": rpc error: code = NotFound desc = could not find container \"8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f\": container with ID starting with 8b224567d8bf24858529db0f4419cb1d794ab9148647d56b07d7824919d64f2f not found: ID does not exist" Jul 16 17:26:26.324381 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.324358 2579 scope.go:117] "RemoveContainer" containerID="5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02" Jul 16 17:26:26.325708 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.325683 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.327067 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.327045 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:26.328454 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.328427 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.333641 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.333619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jcsk\" (UniqueName: \"kubernetes.io/projected/a1f95e1f-5e82-41a9-ac39-ddaf67814c24-kube-api-access-6jcsk\") pod \"limitador-operator-controller-manager-859d7b78bd-dp57g\" (UID: \"a1f95e1f-5e82-41a9-ac39-ddaf67814c24\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" Jul 16 17:26:26.333741 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.333656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efe7bf0f-d35d-40d3-8681-344664f2f0c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgwf9\" (UID: \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:26.333741 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.333693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv7hd\" (UniqueName: \"kubernetes.io/projected/efe7bf0f-d35d-40d3-8681-344664f2f0c4-kube-api-access-zv7hd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgwf9\" (UID: \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:26.334025 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.334006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efe7bf0f-d35d-40d3-8681-344664f2f0c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgwf9\" (UID: \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:26.335072 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.335054 2579 scope.go:117] "RemoveContainer" containerID="5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02" Jul 16 17:26:26.335363 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.335345 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02\": container with ID starting with 5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02 not found: ID does not exist" containerID="5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02" Jul 16 17:26:26.335404 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.335370 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02"} err="failed to get container status \"5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02\": rpc error: code = NotFound desc = could not find container \"5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02\": container with ID starting with 5301a1a053118f5876cfdbea435dd89a98dfdc85f328bce9912e759435d71f02 not found: ID does not exist" Jul 16 17:26:26.343096 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.343075 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv7hd\" (UniqueName: \"kubernetes.io/projected/efe7bf0f-d35d-40d3-8681-344664f2f0c4-kube-api-access-zv7hd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgwf9\" (UID: \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:26.343184 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.343162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jcsk\" (UniqueName: \"kubernetes.io/projected/a1f95e1f-5e82-41a9-ac39-ddaf67814c24-kube-api-access-6jcsk\") pod \"limitador-operator-controller-manager-859d7b78bd-dp57g\" (UID: \"a1f95e1f-5e82-41a9-ac39-ddaf67814c24\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" Jul 16 17:26:26.434940 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.434903 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-extensions-socket-volume\") pod \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\" (UID: \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\") " Jul 16 17:26:26.435092 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.434988 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-extensions-socket-volume\") pod \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\" (UID: \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\") " Jul 16 17:26:26.435092 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.435026 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fg95\" (UniqueName: \"kubernetes.io/projected/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-kube-api-access-4fg95\") pod \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\" (UID: \"ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5\") " Jul 16 17:26:26.435092 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.435052 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwxck\" (UniqueName: \"kubernetes.io/projected/c4429ac8-39f8-4a60-b469-eb42ff17980d-kube-api-access-qwxck\") pod \"c4429ac8-39f8-4a60-b469-eb42ff17980d\" (UID: \"c4429ac8-39f8-4a60-b469-eb42ff17980d\") " Jul 16 17:26:26.435092 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.435090 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8lvl\" (UniqueName: \"kubernetes.io/projected/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-kube-api-access-g8lvl\") pod \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\" (UID: \"30f6bc0e-90cb-4534-8b2b-fcc797abf7a2\") " Jul 16 17:26:26.435263 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.435223 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" (UID: "30f6bc0e-90cb-4534-8b2b-fcc797abf7a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:26:26.435366 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.435352 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-extensions-socket-volume\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:26.435548 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.435519 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" (UID: "ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:26:26.437246 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.437220 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4429ac8-39f8-4a60-b469-eb42ff17980d-kube-api-access-qwxck" (OuterVolumeSpecName: "kube-api-access-qwxck") pod "c4429ac8-39f8-4a60-b469-eb42ff17980d" (UID: "c4429ac8-39f8-4a60-b469-eb42ff17980d"). InnerVolumeSpecName "kube-api-access-qwxck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:26:26.437246 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.437248 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-kube-api-access-4fg95" (OuterVolumeSpecName: "kube-api-access-4fg95") pod "ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" (UID: "ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5"). InnerVolumeSpecName "kube-api-access-4fg95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:26:26.437374 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.437251 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-kube-api-access-g8lvl" (OuterVolumeSpecName: "kube-api-access-g8lvl") pod "30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" (UID: "30f6bc0e-90cb-4534-8b2b-fcc797abf7a2"). InnerVolumeSpecName "kube-api-access-g8lvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:26:26.449549 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.449531 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:26.460027 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.459968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:26.467720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.467696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" Jul 16 17:26:26.536099 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.535981 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-extensions-socket-volume\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:26.536099 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.536021 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fg95\" (UniqueName: \"kubernetes.io/projected/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5-kube-api-access-4fg95\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:26.536099 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.536036 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwxck\" (UniqueName: \"kubernetes.io/projected/c4429ac8-39f8-4a60-b469-eb42ff17980d-kube-api-access-qwxck\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:26.536099 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.536052 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8lvl\" (UniqueName: \"kubernetes.io/projected/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2-kube-api-access-g8lvl\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:26.608314 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.608270 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln"] Jul 16 17:26:26.609886 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:26:26.609859 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e836dcc_fd69_4f32_9565_627ad0598fd7.slice/crio-bb4fe47d7a0d7e4dd4f6c902a5e2486e4f8caec493bbee60cf5c7c1f91bf647b WatchSource:0}: Error finding container bb4fe47d7a0d7e4dd4f6c902a5e2486e4f8caec493bbee60cf5c7c1f91bf647b: Status 404 returned error can't find the container with id bb4fe47d7a0d7e4dd4f6c902a5e2486e4f8caec493bbee60cf5c7c1f91bf647b Jul 16 17:26:26.629486 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.629452 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.630944 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.630922 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:26.632365 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.632337 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.633625 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.633597 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:26.634852 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.634827 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:26.636096 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:26.636069 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:26.844642 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.844587 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g"] Jul 16 17:26:26.846229 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:26.846203 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9"] Jul 16 17:26:26.846876 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:26:26.846847 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f95e1f_5e82_41a9_ac39_ddaf67814c24.slice/crio-0ee3c2d1e90537b0ea0680e3de639ffa03deb091da17398846b27023493e87be WatchSource:0}: Error finding container 0ee3c2d1e90537b0ea0680e3de639ffa03deb091da17398846b27023493e87be: Status 404 returned error can't find the container with id 0ee3c2d1e90537b0ea0680e3de639ffa03deb091da17398846b27023493e87be Jul 16 17:26:26.847613 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:26:26.847591 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe7bf0f_d35d_40d3_8681_344664f2f0c4.slice/crio-d0c5f494c5e2340570a1bbf23b9f195aa7347759635e99762a4edd8ba6565f0f WatchSource:0}: Error finding container d0c5f494c5e2340570a1bbf23b9f195aa7347759635e99762a4edd8ba6565f0f: Status 404 returned error can't find the container with id d0c5f494c5e2340570a1bbf23b9f195aa7347759635e99762a4edd8ba6565f0f Jul 16 17:26:27.215951 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:27.215915 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x2h2c\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x2h2c" Jul 16 17:26:27.217189 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:27.217159 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:27.218367 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.218346 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" path="/var/lib/kubelet/pods/30f6bc0e-90cb-4534-8b2b-fcc797abf7a2/volumes" Jul 16 17:26:27.218454 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:27.218366 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ngsbr\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ngsbr" Jul 16 17:26:27.218583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.218570 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4429ac8-39f8-4a60-b469-eb42ff17980d" path="/var/lib/kubelet/pods/c4429ac8-39f8-4a60-b469-eb42ff17980d/volumes" Jul 16 17:26:27.218913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.218900 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5" path="/var/lib/kubelet/pods/ce64ad9d-dd7a-4185-9e26-177ec4cfc4a5/volumes" Jul 16 17:26:27.326467 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.326423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" event={"ID":"a1f95e1f-5e82-41a9-ac39-ddaf67814c24","Type":"ContainerStarted","Data":"82c7d6a9f43459f0398bfea9c28df4d8ab68a185332bdfeaf5a42a42fdb1d6ce"} Jul 16 17:26:27.326663 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.326486 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" event={"ID":"a1f95e1f-5e82-41a9-ac39-ddaf67814c24","Type":"ContainerStarted","Data":"0ee3c2d1e90537b0ea0680e3de639ffa03deb091da17398846b27023493e87be"} Jul 16 17:26:27.326663 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.326520 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" Jul 16 17:26:27.328566 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.328534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" event={"ID":"efe7bf0f-d35d-40d3-8681-344664f2f0c4","Type":"ContainerStarted","Data":"b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913"} Jul 16 17:26:27.328707 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.328581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" event={"ID":"efe7bf0f-d35d-40d3-8681-344664f2f0c4","Type":"ContainerStarted","Data":"d0c5f494c5e2340570a1bbf23b9f195aa7347759635e99762a4edd8ba6565f0f"} Jul 16 17:26:27.328707 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.328631 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:27.331066 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.331042 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" event={"ID":"8e836dcc-fd69-4f32-9565-627ad0598fd7","Type":"ContainerStarted","Data":"435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8"} Jul 16 17:26:27.331175 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.331082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" event={"ID":"8e836dcc-fd69-4f32-9565-627ad0598fd7","Type":"ContainerStarted","Data":"bb4fe47d7a0d7e4dd4f6c902a5e2486e4f8caec493bbee60cf5c7c1f91bf647b"} Jul 16 17:26:27.331175 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.331052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:27.331175 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.331151 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:27.342664 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.342628 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" podStartSLOduration=1.342615535 podStartE2EDuration="1.342615535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:27.342599075 +0000 UTC m=+410.663815273" watchObservedRunningTime="2026-07-16 17:26:27.342615535 +0000 UTC m=+410.663831699" Jul 16 17:26:27.359645 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:27.359609 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-grsfx\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="30f6bc0e-90cb-4534-8b2b-fcc797abf7a2" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-grsfx" Jul 16 17:26:27.359783 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.359746 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" podStartSLOduration=1.359733772 podStartE2EDuration="1.359733772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:27.358005179 +0000 UTC m=+410.679221342" watchObservedRunningTime="2026-07-16 17:26:27.359733772 +0000 UTC m=+410.680949935" Jul 16 17:26:27.379369 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:27.379322 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" podStartSLOduration=1.37930821 podStartE2EDuration="1.37930821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:27.377381763 +0000 UTC m=+410.698597927" watchObservedRunningTime="2026-07-16 17:26:27.37930821 +0000 UTC m=+410.700524375" Jul 16 17:26:28.506654 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:28.506619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:28.604471 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:28.604434 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:29.089606 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:29.089573 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:29.189170 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:29.189135 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:32.479683 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:32.479650 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:32.580532 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:32.580495 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:35.118411 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:35.118381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:35.220084 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:35.220041 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:35.318723 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:35.318682 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:35.398135 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:35.398042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:38.338881 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.338842 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:38.339291 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.338930 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:38.339291 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.338972 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dp57g" Jul 16 17:26:38.419737 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.419647 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9"] Jul 16 17:26:38.419931 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.419888 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" podUID="efe7bf0f-d35d-40d3-8681-344664f2f0c4" containerName="manager" containerID="cri-o://b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913" gracePeriod=10 Jul 16 17:26:38.676763 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.676705 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:38.730565 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.730532 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efe7bf0f-d35d-40d3-8681-344664f2f0c4-extensions-socket-volume\") pod \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\" (UID: \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\") " Jul 16 17:26:38.730752 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.730604 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv7hd\" (UniqueName: \"kubernetes.io/projected/efe7bf0f-d35d-40d3-8681-344664f2f0c4-kube-api-access-zv7hd\") pod \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\" (UID: \"efe7bf0f-d35d-40d3-8681-344664f2f0c4\") " Jul 16 17:26:38.730936 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.730905 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efe7bf0f-d35d-40d3-8681-344664f2f0c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "efe7bf0f-d35d-40d3-8681-344664f2f0c4" (UID: "efe7bf0f-d35d-40d3-8681-344664f2f0c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:26:38.732635 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.732606 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe7bf0f-d35d-40d3-8681-344664f2f0c4-kube-api-access-zv7hd" (OuterVolumeSpecName: "kube-api-access-zv7hd") pod "efe7bf0f-d35d-40d3-8681-344664f2f0c4" (UID: "efe7bf0f-d35d-40d3-8681-344664f2f0c4"). InnerVolumeSpecName "kube-api-access-zv7hd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:26:38.831873 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.831835 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efe7bf0f-d35d-40d3-8681-344664f2f0c4-extensions-socket-volume\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:38.831873 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:38.831865 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv7hd\" (UniqueName: \"kubernetes.io/projected/efe7bf0f-d35d-40d3-8681-344664f2f0c4-kube-api-access-zv7hd\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:39.395983 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.395943 2579 generic.go:356] "Generic (PLEG): container finished" podID="efe7bf0f-d35d-40d3-8681-344664f2f0c4" containerID="b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913" exitCode=0 Jul 16 17:26:39.396469 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.396003 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" Jul 16 17:26:39.396469 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.396029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" event={"ID":"efe7bf0f-d35d-40d3-8681-344664f2f0c4","Type":"ContainerDied","Data":"b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913"} Jul 16 17:26:39.396469 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.396109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9" event={"ID":"efe7bf0f-d35d-40d3-8681-344664f2f0c4","Type":"ContainerDied","Data":"d0c5f494c5e2340570a1bbf23b9f195aa7347759635e99762a4edd8ba6565f0f"} Jul 16 17:26:39.396469 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.396132 2579 scope.go:117] "RemoveContainer" containerID="b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913" Jul 16 17:26:39.404753 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.404736 2579 scope.go:117] "RemoveContainer" containerID="b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913" Jul 16 17:26:39.405041 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:39.405017 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913\": container with ID starting with b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913 not found: ID does not exist" containerID="b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913" Jul 16 17:26:39.405157 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.405044 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913"} err="failed to get container status \"b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913\": rpc error: code = NotFound desc = could not find container \"b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913\": container with ID starting with b847bc2333b6e1a6b932cddbe432723742349ac56f693afb6ae2e045d7d96913 not found: ID does not exist" Jul 16 17:26:39.413471 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.413447 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9"] Jul 16 17:26:39.421891 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:39.421867 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgwf9"] Jul 16 17:26:41.219235 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:41.219202 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe7bf0f-d35d-40d3-8681-344664f2f0c4" path="/var/lib/kubelet/pods/efe7bf0f-d35d-40d3-8681-344664f2f0c4/volumes" Jul 16 17:26:41.626427 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:41.626388 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:41.682387 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:41.682347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:54.903540 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.903500 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m"] Jul 16 17:26:54.904183 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.904162 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe7bf0f-d35d-40d3-8681-344664f2f0c4" containerName="manager" Jul 16 17:26:54.904230 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.904187 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe7bf0f-d35d-40d3-8681-344664f2f0c4" containerName="manager" Jul 16 17:26:54.904297 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.904284 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe7bf0f-d35d-40d3-8681-344664f2f0c4" containerName="manager" Jul 16 17:26:54.907577 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.907554 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.909832 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.909796 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4wpgw\"" Jul 16 17:26:54.919250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.919227 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m"] Jul 16 17:26:54.947271 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.947232 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:54.975346 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd11f485-e680-4f65-958a-57df6ed182d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.975509 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd11f485-e680-4f65-958a-57df6ed182d0-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.975509 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n8w5\" (UniqueName: \"kubernetes.io/projected/cd11f485-e680-4f65-958a-57df6ed182d0-kube-api-access-7n8w5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.975625 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd11f485-e680-4f65-958a-57df6ed182d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.975625 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.975625 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.975759 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.975759 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:54.975759 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:54.975692 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.076799 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.076762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd11f485-e680-4f65-958a-57df6ed182d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.076799 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.076804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.076848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.076878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.076909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.076945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.077028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd11f485-e680-4f65-958a-57df6ed182d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077069 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.077054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd11f485-e680-4f65-958a-57df6ed182d0-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077376 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.077088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n8w5\" (UniqueName: \"kubernetes.io/projected/cd11f485-e680-4f65-958a-57df6ed182d0-kube-api-access-7n8w5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077479 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.077451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077533 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.077496 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077627 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.077605 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077688 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.077627 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd11f485-e680-4f65-958a-57df6ed182d0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.077688 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.077671 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.079379 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.079357 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd11f485-e680-4f65-958a-57df6ed182d0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.079606 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.079584 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd11f485-e680-4f65-958a-57df6ed182d0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.090841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.090784 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd11f485-e680-4f65-958a-57df6ed182d0-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.091895 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.091874 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n8w5\" (UniqueName: \"kubernetes.io/projected/cd11f485-e680-4f65-958a-57df6ed182d0-kube-api-access-7n8w5\") pod \"maas-default-gateway-openshift-default-5896d4dd49-f494m\" (UID: \"cd11f485-e680-4f65-958a-57df6ed182d0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.199576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.199486 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:55.219145 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.219116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:55.361074 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.361039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m"] Jul 16 17:26:55.364058 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:26:55.364028 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd11f485_e680_4f65_958a_57df6ed182d0.slice/crio-fe51a8649fc4a8fe6790b8d444c91dd0c33b54c9dec217d3fb4427e165f8fe43 WatchSource:0}: Error finding container fe51a8649fc4a8fe6790b8d444c91dd0c33b54c9dec217d3fb4427e165f8fe43: Status 404 returned error can't find the container with id fe51a8649fc4a8fe6790b8d444c91dd0c33b54c9dec217d3fb4427e165f8fe43 Jul 16 17:26:55.366245 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.366214 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:26:55.366322 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.366281 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:26:55.366322 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.366312 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:26:55.476918 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.476834 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" event={"ID":"cd11f485-e680-4f65-958a-57df6ed182d0","Type":"ContainerStarted","Data":"0dbecbf28018a588f0fafa9c32f9a5d22888243073f571b67d2eef252f834fbd"} Jul 16 17:26:55.476918 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.476893 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" event={"ID":"cd11f485-e680-4f65-958a-57df6ed182d0","Type":"ContainerStarted","Data":"fe51a8649fc4a8fe6790b8d444c91dd0c33b54c9dec217d3fb4427e165f8fe43"} Jul 16 17:26:55.495699 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:55.495637 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" podStartSLOduration=1.495615473 podStartE2EDuration="1.495615473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:55.494138694 +0000 UTC m=+438.815354900" watchObservedRunningTime="2026-07-16 17:26:55.495615473 +0000 UTC m=+438.816831642" Jul 16 17:26:56.220148 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.220107 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:56.224844 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.224791 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:56.482120 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.482043 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:56.482960 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.482936 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:26:56.572832 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.572792 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:56.765977 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.765884 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:26:56.768634 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.768608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:26:56.770735 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.770712 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tkdk9\"" Jul 16 17:26:56.770953 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.770742 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 16 17:26:56.779189 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.779157 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:26:56.782563 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.782533 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:56.820637 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.820605 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:26:56.888506 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.888464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:56.893652 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.893624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5653d4b1-fc17-403d-b701-175ae7d68563-config-file\") pod \"limitador-limitador-54d6d988d5-4nprt\" (UID: \"5653d4b1-fc17-403d-b701-175ae7d68563\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:26:56.893756 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.893676 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwlc8\" (UniqueName: \"kubernetes.io/projected/5653d4b1-fc17-403d-b701-175ae7d68563-kube-api-access-cwlc8\") pod \"limitador-limitador-54d6d988d5-4nprt\" (UID: \"5653d4b1-fc17-403d-b701-175ae7d68563\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:26:56.994446 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.994411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5653d4b1-fc17-403d-b701-175ae7d68563-config-file\") pod \"limitador-limitador-54d6d988d5-4nprt\" (UID: \"5653d4b1-fc17-403d-b701-175ae7d68563\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:26:56.994647 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.994470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwlc8\" (UniqueName: \"kubernetes.io/projected/5653d4b1-fc17-403d-b701-175ae7d68563-kube-api-access-cwlc8\") pod \"limitador-limitador-54d6d988d5-4nprt\" (UID: \"5653d4b1-fc17-403d-b701-175ae7d68563\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:26:56.995132 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:56.995112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5653d4b1-fc17-403d-b701-175ae7d68563-config-file\") pod \"limitador-limitador-54d6d988d5-4nprt\" (UID: \"5653d4b1-fc17-403d-b701-175ae7d68563\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:26:57.002999 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:57.002965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwlc8\" (UniqueName: \"kubernetes.io/projected/5653d4b1-fc17-403d-b701-175ae7d68563-kube-api-access-cwlc8\") pod \"limitador-limitador-54d6d988d5-4nprt\" (UID: \"5653d4b1-fc17-403d-b701-175ae7d68563\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:26:57.081916 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:57.081795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:26:57.221788 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:57.221764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:26:57.223831 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:26:57.223793 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5653d4b1_fc17_403d_b701_175ae7d68563.slice/crio-5678ea86850f719e8740b7b4723e9b903c7035608a5f4d63fa9ed851681f78b0 WatchSource:0}: Error finding container 5678ea86850f719e8740b7b4723e9b903c7035608a5f4d63fa9ed851681f78b0: Status 404 returned error can't find the container with id 5678ea86850f719e8740b7b4723e9b903c7035608a5f4d63fa9ed851681f78b0 Jul 16 17:26:57.411793 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:57.411748 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:57.488539 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:57.488499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" event={"ID":"5653d4b1-fc17-403d-b701-175ae7d68563","Type":"ContainerStarted","Data":"5678ea86850f719e8740b7b4723e9b903c7035608a5f4d63fa9ed851681f78b0"} Jul 16 17:26:57.899043 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:57.898990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:26:58.012666 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.012344 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln"] Jul 16 17:26:58.013242 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.013205 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" podUID="8e836dcc-fd69-4f32-9565-627ad0598fd7" containerName="manager" containerID="cri-o://435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8" gracePeriod=10 Jul 16 17:26:58.292575 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.292544 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:58.409516 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.409484 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e836dcc-fd69-4f32-9565-627ad0598fd7-extensions-socket-volume\") pod \"8e836dcc-fd69-4f32-9565-627ad0598fd7\" (UID: \"8e836dcc-fd69-4f32-9565-627ad0598fd7\") " Jul 16 17:26:58.409721 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.409596 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6lc4\" (UniqueName: \"kubernetes.io/projected/8e836dcc-fd69-4f32-9565-627ad0598fd7-kube-api-access-k6lc4\") pod \"8e836dcc-fd69-4f32-9565-627ad0598fd7\" (UID: \"8e836dcc-fd69-4f32-9565-627ad0598fd7\") " Jul 16 17:26:58.409960 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.409928 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e836dcc-fd69-4f32-9565-627ad0598fd7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e836dcc-fd69-4f32-9565-627ad0598fd7" (UID: "8e836dcc-fd69-4f32-9565-627ad0598fd7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:26:58.411916 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.411883 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e836dcc-fd69-4f32-9565-627ad0598fd7-kube-api-access-k6lc4" (OuterVolumeSpecName: "kube-api-access-k6lc4") pod "8e836dcc-fd69-4f32-9565-627ad0598fd7" (UID: "8e836dcc-fd69-4f32-9565-627ad0598fd7"). InnerVolumeSpecName "kube-api-access-k6lc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:26:58.497145 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.497059 2579 generic.go:356] "Generic (PLEG): container finished" podID="8e836dcc-fd69-4f32-9565-627ad0598fd7" containerID="435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8" exitCode=0 Jul 16 17:26:58.497145 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.497103 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" Jul 16 17:26:58.497352 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.497152 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" event={"ID":"8e836dcc-fd69-4f32-9565-627ad0598fd7","Type":"ContainerDied","Data":"435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8"} Jul 16 17:26:58.497352 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.497211 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln" event={"ID":"8e836dcc-fd69-4f32-9565-627ad0598fd7","Type":"ContainerDied","Data":"bb4fe47d7a0d7e4dd4f6c902a5e2486e4f8caec493bbee60cf5c7c1f91bf647b"} Jul 16 17:26:58.497352 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.497240 2579 scope.go:117] "RemoveContainer" containerID="435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8" Jul 16 17:26:58.510764 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.510742 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e836dcc-fd69-4f32-9565-627ad0598fd7-extensions-socket-volume\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:58.510764 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.510764 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6lc4\" (UniqueName: \"kubernetes.io/projected/8e836dcc-fd69-4f32-9565-627ad0598fd7-kube-api-access-k6lc4\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:26:58.528867 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.528836 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln"] Jul 16 17:26:58.531911 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:58.531882 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6nrln"] Jul 16 17:26:59.170782 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:59.169577 2579 scope.go:117] "RemoveContainer" containerID="435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8" Jul 16 17:26:59.170782 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:26:59.170628 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8\": container with ID starting with 435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8 not found: ID does not exist" containerID="435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8" Jul 16 17:26:59.170782 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:59.170667 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8"} err="failed to get container status \"435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8\": rpc error: code = NotFound desc = could not find container \"435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8\": container with ID starting with 435e117ec37af3c0580724d0bdce8e6063ed837bdb594d1005aefd9bcf02e8c8 not found: ID does not exist" Jul 16 17:26:59.219854 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:26:59.219802 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e836dcc-fd69-4f32-9565-627ad0598fd7" path="/var/lib/kubelet/pods/8e836dcc-fd69-4f32-9565-627ad0598fd7/volumes" Jul 16 17:27:00.511456 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:00.511419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" event={"ID":"5653d4b1-fc17-403d-b701-175ae7d68563","Type":"ContainerStarted","Data":"70afab7a4d93444c760cc3dafe13292dd505e6f4e61bfceb37d09337091a4603"} Jul 16 17:27:00.511946 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:00.511495 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:27:00.527237 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:00.527187 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" podStartSLOduration=2.094010293 podStartE2EDuration="4.527168905s" totalImagesPullingTime="2.433158612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:27:00.525652849 +0000 UTC m=+443.846869024" watchObservedRunningTime="2026-07-16 17:27:00.527168905 +0000 UTC m=+443.848385069" Jul 16 17:27:11.517845 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:11.517788 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4nprt" Jul 16 17:27:14.123525 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.123490 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64f5696cd-5fpgc"] Jul 16 17:27:14.123913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.123893 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e836dcc-fd69-4f32-9565-627ad0598fd7" containerName="manager" Jul 16 17:27:14.123913 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.123906 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e836dcc-fd69-4f32-9565-627ad0598fd7" containerName="manager" Jul 16 17:27:14.123988 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.123973 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e836dcc-fd69-4f32-9565-627ad0598fd7" containerName="manager" Jul 16 17:27:14.127325 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.127304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.130313 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.130293 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 17:27:14.131121 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.131099 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 17:27:14.131216 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.131190 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 17:27:14.131503 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.131489 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 17:27:14.134635 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.134319 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2bqjs\"" Jul 16 17:27:14.134635 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.134346 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 17:27:14.143293 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.143267 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 17:27:14.153838 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.151096 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f5696cd-5fpgc"] Jul 16 17:27:14.250227 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.250175 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:14.259294 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.259257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-serving-cert\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.259442 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.259301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-oauth-config\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.259442 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.259344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-config\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.259442 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.259372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-oauth-serving-cert\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.259442 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.259402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhjzf\" (UniqueName: \"kubernetes.io/projected/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-kube-api-access-hhjzf\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.259634 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.259487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-service-ca\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.259634 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.259511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-trusted-ca-bundle\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.324723 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.324681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:14.360516 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.360478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-config\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.360516 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.360514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-oauth-serving-cert\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.360736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.360539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjzf\" (UniqueName: \"kubernetes.io/projected/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-kube-api-access-hhjzf\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.360736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.360602 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-service-ca\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.360736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.360621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-trusted-ca-bundle\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.360925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.360790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-serving-cert\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.360925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.360881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-oauth-config\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.361304 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.361275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-oauth-serving-cert\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.361405 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.361320 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-config\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.361455 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.361427 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-service-ca\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.361586 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.361568 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-trusted-ca-bundle\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.363351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.363331 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-serving-cert\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.363421 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.363355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-console-oauth-config\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.368071 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.368053 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjzf\" (UniqueName: \"kubernetes.io/projected/f109faa8-47b0-4be0-a8ed-bf2025b3a77c-kube-api-access-hhjzf\") pod \"console-64f5696cd-5fpgc\" (UID: \"f109faa8-47b0-4be0-a8ed-bf2025b3a77c\") " pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.437532 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.437438 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:14.573629 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:14.573604 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f5696cd-5fpgc"] Jul 16 17:27:14.575922 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:27:14.575894 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf109faa8_47b0_4be0_a8ed_bf2025b3a77c.slice/crio-749c0cc991b26d0ec9a771202ba53ad6d272685e3c12c4c99999aaef2d1eb45c WatchSource:0}: Error finding container 749c0cc991b26d0ec9a771202ba53ad6d272685e3c12c4c99999aaef2d1eb45c: Status 404 returned error can't find the container with id 749c0cc991b26d0ec9a771202ba53ad6d272685e3c12c4c99999aaef2d1eb45c Jul 16 17:27:15.585794 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:15.585755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f5696cd-5fpgc" event={"ID":"f109faa8-47b0-4be0-a8ed-bf2025b3a77c","Type":"ContainerStarted","Data":"c7b1da735a90f84ce310d86b77c62bea956389dc723035f497fd4e735fc6c170"} Jul 16 17:27:15.586290 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:15.585832 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f5696cd-5fpgc" event={"ID":"f109faa8-47b0-4be0-a8ed-bf2025b3a77c","Type":"ContainerStarted","Data":"749c0cc991b26d0ec9a771202ba53ad6d272685e3c12c4c99999aaef2d1eb45c"} Jul 16 17:27:15.602336 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:15.602277 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64f5696cd-5fpgc" podStartSLOduration=1.602256417 podStartE2EDuration="1.602256417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:27:15.601522724 +0000 UTC m=+458.922738888" watchObservedRunningTime="2026-07-16 17:27:15.602256417 +0000 UTC m=+458.923472582" Jul 16 17:27:22.923284 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:22.923248 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:23.027767 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.027709 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:23.387787 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.387754 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m62ll"] Jul 16 17:27:23.392051 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.392025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:23.394143 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.394119 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 16 17:27:23.394275 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.394222 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-c9fbz\"" Jul 16 17:27:23.394275 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.394224 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 17:27:23.394611 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.394594 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 17:27:23.403050 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.403026 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m62ll"] Jul 16 17:27:23.440909 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.440876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x9nv\" (UniqueName: \"kubernetes.io/projected/6d7479b3-0732-4a3a-a10e-64791153db58-kube-api-access-8x9nv\") pod \"postgres-69fb4594cf-m62ll\" (UID: \"6d7479b3-0732-4a3a-a10e-64791153db58\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:23.441082 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.440921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6d7479b3-0732-4a3a-a10e-64791153db58-data\") pod \"postgres-69fb4594cf-m62ll\" (UID: \"6d7479b3-0732-4a3a-a10e-64791153db58\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:23.446315 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.446286 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:23.541325 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.541289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9nv\" (UniqueName: \"kubernetes.io/projected/6d7479b3-0732-4a3a-a10e-64791153db58-kube-api-access-8x9nv\") pod \"postgres-69fb4594cf-m62ll\" (UID: \"6d7479b3-0732-4a3a-a10e-64791153db58\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:23.541513 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.541342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6d7479b3-0732-4a3a-a10e-64791153db58-data\") pod \"postgres-69fb4594cf-m62ll\" (UID: \"6d7479b3-0732-4a3a-a10e-64791153db58\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:23.541721 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.541704 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6d7479b3-0732-4a3a-a10e-64791153db58-data\") pod \"postgres-69fb4594cf-m62ll\" (UID: \"6d7479b3-0732-4a3a-a10e-64791153db58\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:23.549096 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.549072 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x9nv\" (UniqueName: \"kubernetes.io/projected/6d7479b3-0732-4a3a-a10e-64791153db58-kube-api-access-8x9nv\") pod \"postgres-69fb4594cf-m62ll\" (UID: \"6d7479b3-0732-4a3a-a10e-64791153db58\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:23.704656 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.704550 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:23.838910 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:23.838881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m62ll"] Jul 16 17:27:23.841087 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:27:23.841061 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7479b3_0732_4a3a_a10e_64791153db58.slice/crio-f4d81a809e4299a2875e848cc0027e4f5422a4f0fe5a17a8a02ac6d6b9bdad95 WatchSource:0}: Error finding container f4d81a809e4299a2875e848cc0027e4f5422a4f0fe5a17a8a02ac6d6b9bdad95: Status 404 returned error can't find the container with id f4d81a809e4299a2875e848cc0027e4f5422a4f0fe5a17a8a02ac6d6b9bdad95 Jul 16 17:27:24.437736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:24.437704 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:24.438159 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:24.437795 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:24.442758 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:24.442733 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:24.629412 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:24.629377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" event={"ID":"6d7479b3-0732-4a3a-a10e-64791153db58","Type":"ContainerStarted","Data":"f4d81a809e4299a2875e848cc0027e4f5422a4f0fe5a17a8a02ac6d6b9bdad95"} Jul 16 17:27:24.633366 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:24.633344 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64f5696cd-5fpgc" Jul 16 17:27:24.802995 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:24.802906 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:31.676208 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:31.676170 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" event={"ID":"6d7479b3-0732-4a3a-a10e-64791153db58","Type":"ContainerStarted","Data":"595dd4bb60b0da51a154056724a225220aa4f15169a9227a5e2f8546d47f5ce4"} Jul 16 17:27:31.676711 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:31.676274 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:31.711398 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:31.711344 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" podStartSLOduration=1.023224809 podStartE2EDuration="8.711328761s" totalImagesPullingTime="7.688103952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:27:31.7095255 +0000 UTC m=+475.030741664" watchObservedRunningTime="2026-07-16 17:27:31.711328761 +0000 UTC m=+475.032544924" Jul 16 17:27:37.711236 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:37.711207 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m62ll" Jul 16 17:27:38.017938 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:38.017852 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:38.617191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:38.617153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:45.149685 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:45.149637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:45.248132 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:45.248091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:45.345132 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:45.345091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:48.461902 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:48.461859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:48.573314 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:48.573276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:27:52.552388 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:27:52.552351 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:16.422686 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:16.422637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:16.522254 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:16.522216 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:19.241145 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:19.241107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:19.340600 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:19.340568 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:19.790961 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:19.790927 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:19.973798 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:19.973759 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:20.354629 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:20.354592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:20.450471 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:20.450426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:20.603892 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:20.603842 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:28:27.524020 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:27.523976 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-f494m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 16 17:28:27.524470 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:27.524068 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" podUID="cd11f485-e680-4f65-958a-57df6ed182d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 16 17:28:28.013196 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:28.013142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:28.808910 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:28.808868 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:28.955186 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:28.955152 2579 generic.go:356] "Generic (PLEG): container finished" podID="cd11f485-e680-4f65-958a-57df6ed182d0" containerID="0dbecbf28018a588f0fafa9c32f9a5d22888243073f571b67d2eef252f834fbd" exitCode=0 Jul 16 17:28:28.955367 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:28.955224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" event={"ID":"cd11f485-e680-4f65-958a-57df6ed182d0","Type":"ContainerDied","Data":"0dbecbf28018a588f0fafa9c32f9a5d22888243073f571b67d2eef252f834fbd"} Jul 16 17:28:28.955617 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:28.955602 2579 scope.go:117] "RemoveContainer" containerID="0dbecbf28018a588f0fafa9c32f9a5d22888243073f571b67d2eef252f834fbd" Jul 16 17:28:28.956663 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:28.956634 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:28:28.956738 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:28.956720 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:28:28.956790 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:28.956773 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:28:29.962314 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:29.962225 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" event={"ID":"cd11f485-e680-4f65-958a-57df6ed182d0","Type":"ContainerStarted","Data":"93cda62924c0f48283391c62e60ec2dacc338060f5b58a05b2e2acc39816a60d"} Jul 16 17:28:29.990363 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:29.990319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:30.088662 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:30.088605 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:30.219721 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:30.219631 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:28:30.219967 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:30.219939 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-f494m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 16 17:28:30.220205 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:30.220178 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" podUID="cd11f485-e680-4f65-958a-57df6ed182d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 16 17:28:31.220148 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:31.220106 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-f494m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 16 17:28:31.220640 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:31.220171 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" podUID="cd11f485-e680-4f65-958a-57df6ed182d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 16 17:28:32.219594 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:32.219560 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-f494m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 16 17:28:32.219786 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:32.219614 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" podUID="cd11f485-e680-4f65-958a-57df6ed182d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 16 17:28:33.219710 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:33.219668 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-f494m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 16 17:28:33.220202 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:33.219720 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" podUID="cd11f485-e680-4f65-958a-57df6ed182d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 16 17:28:34.220165 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:34.220121 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-f494m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 16 17:28:34.220634 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:34.220187 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" podUID="cd11f485-e680-4f65-958a-57df6ed182d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 16 17:28:35.222761 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:35.222729 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:28:35.223263 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:35.223130 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:28:35.224064 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:35.224045 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-f494m" Jul 16 17:28:43.732183 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:43.732146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:44.160528 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:44.160490 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:28:53.800576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:53.800536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:54.476957 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:54.476921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:28:59.554005 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:59.553959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:28:59.606456 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:28:59.606421 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:03.396249 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.396212 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d"] Jul 16 17:29:03.398938 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.398913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.406057 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.405742 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5kmqq\"" Jul 16 17:29:03.406057 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.405758 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 17:29:03.406057 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.405771 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 17:29:03.406057 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.405748 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 17:29:03.416137 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.416112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d"] Jul 16 17:29:03.450369 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.450330 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:03.550734 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.550694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.550966 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.550768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.550966 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.550787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.550966 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.550802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c63793-f3fb-4755-8526-8da460d76af6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.550966 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.550855 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52fbx\" (UniqueName: \"kubernetes.io/projected/75c63793-f3fb-4755-8526-8da460d76af6-kube-api-access-52fbx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.550966 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.550882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652021 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.651928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652021 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.651997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652021 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.652014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652252 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.652030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c63793-f3fb-4755-8526-8da460d76af6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652252 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.652047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52fbx\" (UniqueName: \"kubernetes.io/projected/75c63793-f3fb-4755-8526-8da460d76af6-kube-api-access-52fbx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652252 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.652074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652444 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.652421 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652480 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.652451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.652514 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.652475 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.654478 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.654459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c63793-f3fb-4755-8526-8da460d76af6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.654594 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.654578 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c63793-f3fb-4755-8526-8da460d76af6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.660148 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.660121 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52fbx\" (UniqueName: \"kubernetes.io/projected/75c63793-f3fb-4755-8526-8da460d76af6-kube-api-access-52fbx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tc9d\" (UID: \"75c63793-f3fb-4755-8526-8da460d76af6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.710212 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.710168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:03.849426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:03.849399 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d"] Jul 16 17:29:03.851569 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:29:03.851543 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c63793_f3fb_4755_8526_8da460d76af6.slice/crio-321cc9b1cad1c6e8fa757c9356cb2d1eddf2a1803a6f972bd3c4f66533314248 WatchSource:0}: Error finding container 321cc9b1cad1c6e8fa757c9356cb2d1eddf2a1803a6f972bd3c4f66533314248: Status 404 returned error can't find the container with id 321cc9b1cad1c6e8fa757c9356cb2d1eddf2a1803a6f972bd3c4f66533314248 Jul 16 17:29:04.127182 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:04.127147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" event={"ID":"75c63793-f3fb-4755-8526-8da460d76af6","Type":"ContainerStarted","Data":"321cc9b1cad1c6e8fa757c9356cb2d1eddf2a1803a6f972bd3c4f66533314248"} Jul 16 17:29:04.573652 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:04.573527 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:29:06.147887 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:06.147847 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" event={"ID":"75c63793-f3fb-4755-8526-8da460d76af6","Type":"ContainerStarted","Data":"86636abf3f89bafda8bb2f4bb6600926d9a66a27e96a2df7521146f538b30dff"} Jul 16 17:29:06.165724 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:06.165674 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" podStartSLOduration=1.7015655060000001 podStartE2EDuration="3.165658178s" totalImagesPullingTime="1.464092672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:06.164463133 +0000 UTC m=+569.485679297" watchObservedRunningTime="2026-07-16 17:29:06.165658178 +0000 UTC m=+569.486874320" Jul 16 17:29:13.710333 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:13.710291 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:13.710747 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:13.710361 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:13.723505 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:13.723477 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:14.202965 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:14.202933 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tc9d" Jul 16 17:29:19.128416 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:19.128373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:20.765629 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:20.765586 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:29:24.196110 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:24.196077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:25.986921 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:25.986878 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:26.088089 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:26.088050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:26.369468 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:26.369440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:26.470458 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:26.470420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:37.196788 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:37.196755 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:29:37.199482 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:37.199454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:29:37.200045 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:37.200027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:29:37.202719 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:37.202702 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:29:42.616626 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:42.616589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:44.665195 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:44.665153 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:29:51.916631 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:51.916590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:29:54.570340 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:29:54.569679 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:30:00.138247 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:00.138161 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7"] Jul 16 17:30:00.143275 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:00.143239 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" Jul 16 17:30:00.146064 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:00.146036 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n8n99\"" Jul 16 17:30:00.150045 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:00.150015 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7"] Jul 16 17:30:00.156574 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:00.156551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" Jul 16 17:30:00.293743 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:00.293711 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7"] Jul 16 17:30:00.297545 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:30:00.297521 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a7c9a9_3149_4649_b258_ea205e2c1b95.slice/crio-f829976f7e3cf80f17dc0b29573d21b6a15e29425340e35aa704c493bb811efe WatchSource:0}: Error finding container f829976f7e3cf80f17dc0b29573d21b6a15e29425340e35aa704c493bb811efe: Status 404 returned error can't find the container with id f829976f7e3cf80f17dc0b29573d21b6a15e29425340e35aa704c493bb811efe Jul 16 17:30:00.413935 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:00.413846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" event={"ID":"89a7c9a9-3149-4649-b258-ea205e2c1b95","Type":"ContainerStarted","Data":"f829976f7e3cf80f17dc0b29573d21b6a15e29425340e35aa704c493bb811efe"} Jul 16 17:30:03.433586 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:03.433546 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" event={"ID":"89a7c9a9-3149-4649-b258-ea205e2c1b95","Type":"ContainerStarted","Data":"4febdf1ab7fcd93c2c28ed5acda60daa6017942fa4349c0f2f4910fcfdc1c15e"} Jul 16 17:30:03.450563 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:03.450503 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" podStartSLOduration=1.059677813 podStartE2EDuration="3.450487938s" totalImagesPullingTime="2.390810125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:03.448196529 +0000 UTC m=+626.769412694" watchObservedRunningTime="2026-07-16 17:30:03.450487938 +0000 UTC m=+626.771704101" Jul 16 17:30:04.440642 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:04.440604 2579 generic.go:356] "Generic (PLEG): container finished" podID="89a7c9a9-3149-4649-b258-ea205e2c1b95" containerID="4febdf1ab7fcd93c2c28ed5acda60daa6017942fa4349c0f2f4910fcfdc1c15e" exitCode=0 Jul 16 17:30:04.441074 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:04.440699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" event={"ID":"89a7c9a9-3149-4649-b258-ea205e2c1b95","Type":"ContainerDied","Data":"4febdf1ab7fcd93c2c28ed5acda60daa6017942fa4349c0f2f4910fcfdc1c15e"} Jul 16 17:30:05.581476 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:05.581450 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" Jul 16 17:30:06.452034 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:06.452004 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" Jul 16 17:30:06.452203 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:06.452004 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737050-47dq7" event={"ID":"89a7c9a9-3149-4649-b258-ea205e2c1b95","Type":"ContainerDied","Data":"f829976f7e3cf80f17dc0b29573d21b6a15e29425340e35aa704c493bb811efe"} Jul 16 17:30:06.452203 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:06.452129 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f829976f7e3cf80f17dc0b29573d21b6a15e29425340e35aa704c493bb811efe" Jul 16 17:30:51.361452 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:30:51.361415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:31:01.809624 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:31:01.809576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:31:30.901720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:31:30.901629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:31:31.012338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:31:31.012301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:31:33.882036 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:31:33.881992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:31:33.982186 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:31:33.982131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:32:00.665380 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:32:00.665344 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:32:09.964956 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:32:09.964919 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:32:21.719215 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:32:21.719175 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:33:36.894195 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:33:36.894135 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:33:38.114966 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:33:38.114929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:04.971396 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:04.971355 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:34:13.931896 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:13.931862 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:14.026278 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:14.026249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:14.168102 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:14.168067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:14.276064 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:14.275981 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:34:19.836785 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:19.836749 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:19.899250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:19.899212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:19.976699 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:19.976653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:21.693701 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:21.693669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:21.793462 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:21.793428 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:25.917562 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:25.917512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:25.981514 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:25.981478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:34:26.764280 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:26.764242 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:34:37.227987 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:37.227906 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:34:37.231760 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:37.231733 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:34:37.232776 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:37.232752 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:34:37.236102 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:37.236083 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:34:43.498654 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:43.498617 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:34:53.162436 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:34:53.162397 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:35:02.864833 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:02.864786 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:35:07.391136 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:07.391098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:07.446699 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:07.446641 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:10.541863 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:10.541804 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:12.068303 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:12.068265 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:35:23.271298 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:23.271257 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:35:34.472458 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:34.472413 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:35:45.662359 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:45.662323 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:35:53.203220 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:53.203186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:35:55.458944 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:35:55.458905 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:36:18.173888 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:36:18.173848 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:36:30.149581 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:36:30.149544 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:36:52.268206 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:36:52.268168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:37:03.755510 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:37:03.755474 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:37:19.567683 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:37:19.567640 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:37:29.374276 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:37:29.374191 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:37:40.021868 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:37:40.021806 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:37:41.093080 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:37:41.093043 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:37:50.468532 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:37:50.468493 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:38:00.363858 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:38:00.363798 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:39:25.950945 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:25.950910 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws"] Jul 16 17:39:25.951437 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:25.951306 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a7c9a9-3149-4649-b258-ea205e2c1b95" containerName="cleanup" Jul 16 17:39:25.951437 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:25.951317 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a7c9a9-3149-4649-b258-ea205e2c1b95" containerName="cleanup" Jul 16 17:39:25.951437 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:25.951385 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="89a7c9a9-3149-4649-b258-ea205e2c1b95" containerName="cleanup" Jul 16 17:39:25.954370 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:25.954354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:25.956748 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:25.956731 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lc8q4\"" Jul 16 17:39:25.966801 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:25.966777 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws"] Jul 16 17:39:26.045028 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:26.044992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2bmq\" (UniqueName: \"kubernetes.io/projected/918c522c-3dce-422b-b46e-f03d9f126603-kube-api-access-d2bmq\") pod \"kuadrant-operator-controller-manager-86878c769f-x7xws\" (UID: \"918c522c-3dce-422b-b46e-f03d9f126603\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:26.045198 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:26.045110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/918c522c-3dce-422b-b46e-f03d9f126603-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x7xws\" (UID: \"918c522c-3dce-422b-b46e-f03d9f126603\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:26.146441 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:26.146399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/918c522c-3dce-422b-b46e-f03d9f126603-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x7xws\" (UID: \"918c522c-3dce-422b-b46e-f03d9f126603\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:26.146631 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:26.146458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bmq\" (UniqueName: \"kubernetes.io/projected/918c522c-3dce-422b-b46e-f03d9f126603-kube-api-access-d2bmq\") pod \"kuadrant-operator-controller-manager-86878c769f-x7xws\" (UID: \"918c522c-3dce-422b-b46e-f03d9f126603\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:26.146871 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:26.146809 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/918c522c-3dce-422b-b46e-f03d9f126603-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x7xws\" (UID: \"918c522c-3dce-422b-b46e-f03d9f126603\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:26.154651 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:26.154632 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2bmq\" (UniqueName: \"kubernetes.io/projected/918c522c-3dce-422b-b46e-f03d9f126603-kube-api-access-d2bmq\") pod \"kuadrant-operator-controller-manager-86878c769f-x7xws\" (UID: \"918c522c-3dce-422b-b46e-f03d9f126603\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:26.265219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:26.265132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:26.412140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:26.412112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws"] Jul 16 17:39:26.412894 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:39:26.412859 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918c522c_3dce_422b_b46e_f03d9f126603.slice/crio-f65d2666182dea773deb392d86fa728a1c87df1806afb3b4942963e8135c32c3 WatchSource:0}: Error finding container f65d2666182dea773deb392d86fa728a1c87df1806afb3b4942963e8135c32c3: Status 404 returned error can't find the container with id f65d2666182dea773deb392d86fa728a1c87df1806afb3b4942963e8135c32c3 Jul 16 17:39:27.282595 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:27.282556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" event={"ID":"918c522c-3dce-422b-b46e-f03d9f126603","Type":"ContainerStarted","Data":"8ddc37095362447ef3daab35efe3feaf4e0713ab61a3b37ffe350a8ec35648a9"} Jul 16 17:39:27.283013 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:27.282616 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" event={"ID":"918c522c-3dce-422b-b46e-f03d9f126603","Type":"ContainerStarted","Data":"f65d2666182dea773deb392d86fa728a1c87df1806afb3b4942963e8135c32c3"} Jul 16 17:39:27.283013 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:27.282644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:27.306793 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:27.306742 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" podStartSLOduration=2.3067242119999998 podStartE2EDuration="2.306724212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:39:27.304166968 +0000 UTC m=+1190.625383157" watchObservedRunningTime="2026-07-16 17:39:27.306724212 +0000 UTC m=+1190.627940438" Jul 16 17:39:37.258421 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:37.258389 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:39:37.261409 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:37.261384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:39:37.265855 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:37.265832 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:39:37.268643 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:37.268622 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:39:38.291358 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:38.291322 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x7xws" Jul 16 17:39:45.182298 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:45.182258 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:39:53.780982 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:39:53.780939 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:40:08.648764 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:40:08.648725 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:40:21.889615 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:40:21.889578 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:40:31.390912 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:40:31.390802 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:40:41.186015 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:40:41.185976 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:40:52.181050 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:40:52.181010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:41:01.980868 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:41:01.980806 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:41:03.454072 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:41:03.454040 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:41:13.173142 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:41:13.173103 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:41:22.281752 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:41:22.281713 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:41:32.879444 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:41:32.879402 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:41:55.079872 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:41:55.079812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:41:56.438603 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:41:56.438558 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:42:03.990471 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:42:03.990437 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:42:13.685613 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:42:13.685576 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:42:26.288587 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:42:26.288550 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:42:43.681351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:42:43.681313 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:42:52.984278 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:42:52.984237 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:43:02.576270 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:43:02.576233 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:43:12.989405 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:43:12.989369 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:43:22.388350 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:43:22.388307 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:43:32.090468 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:43:32.090376 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:43:45.374860 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:43:45.374805 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:43:54.588700 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:43:54.588665 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:44:04.185629 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:04.185590 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:44:16.985426 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:16.985386 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:44:23.235730 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:23.235694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:44:26.008906 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:26.008867 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:44:33.183496 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:33.183456 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:44:37.289149 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:37.289119 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:44:37.295410 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:37.295384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:44:37.300783 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:37.300760 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:44:37.303793 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:37.303774 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:44:50.979562 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:44:50.979525 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:45:02.383644 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:02.383559 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:45:03.185979 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:03.185927 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:13.781867 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:13.781827 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:45:16.463286 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:16.463181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:23.983941 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:23.983869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:26.282248 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:26.282216 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:45:32.249439 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:32.249383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:37.436045 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:37.435994 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:39.777053 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:39.777015 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:45:40.543789 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:40.543733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:40.643408 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:40.643361 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:41.042268 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:41.042219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:46.876809 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:46.876774 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:46.951878 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:46.951836 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:47.052502 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.052211 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w"] Jul 16 17:45:47.056103 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.056080 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.058217 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.058192 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-09ede848-openshift-default-dockercfg-cvt6q\"" Jul 16 17:45:47.073410 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.073384 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w"] Jul 16 17:45:47.087785 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.087753 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:47.144839 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.144712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd00d36-52ff-4586-8173-d14b3400134b-istio-podinfo\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.144839 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.144769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-certs\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.145070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.144962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-credential-socket\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.145070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.144994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-socket\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.145070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.145010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-data\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.145070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.145028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-envoy\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.145070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.145051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-istio-token\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.145070 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.145068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwkz2\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-kube-api-access-xwkz2\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.145275 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.145087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd00d36-52ff-4586-8173-d14b3400134b-istiod-ca-cert\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.192924 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.192893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:47.245980 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.245941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-credential-socket\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.246176 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.245989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-socket\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.246176 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-data\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.246176 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-envoy\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-istio-token\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246376 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-credential-socket\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwkz2\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-kube-api-access-xwkz2\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd00d36-52ff-4586-8173-d14b3400134b-istiod-ca-cert\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd00d36-52ff-4586-8173-d14b3400134b-istio-podinfo\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-certs\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.246949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-socket\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247210 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.247120 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-data\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247774 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.247403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-certs\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.247774 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.247595 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd00d36-52ff-4586-8173-d14b3400134b-istiod-ca-cert\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.249554 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.249482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-envoy\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.250171 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.250130 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd00d36-52ff-4586-8173-d14b3400134b-istio-podinfo\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.264541 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.264127 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-istio-token\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.264541 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.264498 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwkz2\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-kube-api-access-xwkz2\") pod \"e2e-ait-09ede848-openshift-default-75956b84bf-sw44w\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.290841 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.290781 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:47.360422 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.360379 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:47.367609 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.367585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:47.527219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.527189 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w"] Jul 16 17:45:47.529078 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:45:47.529048 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd00d36_52ff_4586_8173_d14b3400134b.slice/crio-83284fcf495707970cbb123ddbedce44b1821dfafd2150e1b23dd65d0d97467a WatchSource:0}: Error finding container 83284fcf495707970cbb123ddbedce44b1821dfafd2150e1b23dd65d0d97467a: Status 404 returned error can't find the container with id 83284fcf495707970cbb123ddbedce44b1821dfafd2150e1b23dd65d0d97467a Jul 16 17:45:47.531617 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.531577 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:45:47.531709 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.531663 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:45:47.531709 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.531703 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:45:47.794042 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.793948 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:47.891466 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.891434 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:47.989811 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:47.989777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:48.275989 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:48.275956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" event={"ID":"6cd00d36-52ff-4586-8173-d14b3400134b","Type":"ContainerStarted","Data":"981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef"} Jul 16 17:45:48.276192 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:48.276020 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" event={"ID":"6cd00d36-52ff-4586-8173-d14b3400134b","Type":"ContainerStarted","Data":"83284fcf495707970cbb123ddbedce44b1821dfafd2150e1b23dd65d0d97467a"} Jul 16 17:45:48.297527 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:48.297476 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" podStartSLOduration=1.29746134 podStartE2EDuration="1.29746134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:48.295469861 +0000 UTC m=+1571.616686044" watchObservedRunningTime="2026-07-16 17:45:48.29746134 +0000 UTC m=+1571.618677504" Jul 16 17:45:48.368586 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:48.368547 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:48.373654 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:48.373625 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:49.281446 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:49.281411 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:49.282436 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:49.282417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:51.053914 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:51.053885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:51.682968 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:51.682929 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:45:54.512701 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:54.512660 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w"] Jul 16 17:45:54.513273 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:54.512922 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" podUID="6cd00d36-52ff-4586-8173-d14b3400134b" containerName="istio-proxy" containerID="cri-o://981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef" gracePeriod=30 Jul 16 17:45:54.540448 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:54.540401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:54.647064 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:54.647028 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:57.780018 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:57.779968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:45:59.670281 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.670255 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:45:59.768725 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.768618 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-data\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.768725 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.768684 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwkz2\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-kube-api-access-xwkz2\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.768725 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.768720 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-envoy\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.769054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.768745 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-certs\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.769054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.768769 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-socket\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.769054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.768803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-istio-token\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.769054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.768902 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd00d36-52ff-4586-8173-d14b3400134b-istiod-ca-cert\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.769054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.768932 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-credential-socket\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.769054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769032 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd00d36-52ff-4586-8173-d14b3400134b-istio-podinfo\") pod \"6cd00d36-52ff-4586-8173-d14b3400134b\" (UID: \"6cd00d36-52ff-4586-8173-d14b3400134b\") " Jul 16 17:45:59.769352 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769079 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:45:59.769352 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769130 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:45:59.769352 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769328 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd00d36-52ff-4586-8173-d14b3400134b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:45:59.769583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769416 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd00d36-52ff-4586-8173-d14b3400134b-istiod-ca-cert\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:45:59.769583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769438 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-certs\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:45:59.769583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769452 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-workload-socket\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:45:59.769583 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769455 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:45:59.769808 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.769696 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:45:59.771294 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.771266 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cd00d36-52ff-4586-8173-d14b3400134b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 17:45:59.771442 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.771273 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:45:59.771505 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.771473 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:45:59.771585 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.771558 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-kube-api-access-xwkz2" (OuterVolumeSpecName: "kube-api-access-xwkz2") pod "6cd00d36-52ff-4586-8173-d14b3400134b" (UID: "6cd00d36-52ff-4586-8173-d14b3400134b"). InnerVolumeSpecName "kube-api-access-xwkz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:45:59.870198 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.870163 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwkz2\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-kube-api-access-xwkz2\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:45:59.870198 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.870202 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-envoy\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:45:59.870408 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.870214 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd00d36-52ff-4586-8173-d14b3400134b-istio-token\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:45:59.870408 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.870222 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-credential-socket\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:45:59.870408 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.870231 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd00d36-52ff-4586-8173-d14b3400134b-istio-podinfo\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:45:59.870408 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:45:59.870239 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd00d36-52ff-4586-8173-d14b3400134b-istio-data\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:00.341444 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.341406 2579 generic.go:356] "Generic (PLEG): container finished" podID="6cd00d36-52ff-4586-8173-d14b3400134b" containerID="981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef" exitCode=0 Jul 16 17:46:00.341636 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.341454 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" Jul 16 17:46:00.341636 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.341494 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" event={"ID":"6cd00d36-52ff-4586-8173-d14b3400134b","Type":"ContainerDied","Data":"981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef"} Jul 16 17:46:00.341636 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.341556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w" event={"ID":"6cd00d36-52ff-4586-8173-d14b3400134b","Type":"ContainerDied","Data":"83284fcf495707970cbb123ddbedce44b1821dfafd2150e1b23dd65d0d97467a"} Jul 16 17:46:00.341636 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.341586 2579 scope.go:117] "RemoveContainer" containerID="981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef" Jul 16 17:46:00.351394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.351374 2579 scope.go:117] "RemoveContainer" containerID="981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef" Jul 16 17:46:00.351672 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:46:00.351652 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef\": container with ID starting with 981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef not found: ID does not exist" containerID="981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef" Jul 16 17:46:00.351728 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.351681 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef"} err="failed to get container status \"981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef\": rpc error: code = NotFound desc = could not find container \"981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef\": container with ID starting with 981e4a45602e3634fe8dd8103bb1c0d60626339e50bb73ff0439bc7056b964ef not found: ID does not exist" Jul 16 17:46:00.376414 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.376380 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w"] Jul 16 17:46:00.384866 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.384839 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-09ede848-openshift-default-75956b84bf-sw44w"] Jul 16 17:46:00.761754 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.761721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:00.862120 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:00.862088 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:01.025759 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.025673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:01.125062 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.125030 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:01.187145 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.187114 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl"] Jul 16 17:46:01.187526 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.187514 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd00d36-52ff-4586-8173-d14b3400134b" containerName="istio-proxy" Jul 16 17:46:01.187571 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.187528 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd00d36-52ff-4586-8173-d14b3400134b" containerName="istio-proxy" Jul 16 17:46:01.187621 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.187612 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd00d36-52ff-4586-8173-d14b3400134b" containerName="istio-proxy" Jul 16 17:46:01.191519 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.191496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.193345 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.193322 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-bc4fabbb-gw-openshift-default-dockercfg-4dc6c\"" Jul 16 17:46:01.201800 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.201770 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl"] Jul 16 17:46:01.220391 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.220347 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd00d36-52ff-4586-8173-d14b3400134b" path="/var/lib/kubelet/pods/6cd00d36-52ff-4586-8173-d14b3400134b/volumes" Jul 16 17:46:01.225234 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.225209 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:01.281455 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-token\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.281455 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istiod-ca-cert\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.281455 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-envoy\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.281733 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-credential-socket\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.281733 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-575zm\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-kube-api-access-575zm\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.281733 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-socket\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.281733 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-podinfo\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.281733 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-certs\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.281733 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.281729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-data\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.326364 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.326330 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:01.382747 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.382714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-credential-socket\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.382961 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.382776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-575zm\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-kube-api-access-575zm\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.382961 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.382807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-socket\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.382961 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.382841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-podinfo\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.382961 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.382891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-certs\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.382961 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.382915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-data\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.382961 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.382957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-token\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.383302 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.382985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istiod-ca-cert\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.383302 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.383025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-envoy\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.383302 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.383202 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-credential-socket\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.383302 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.383245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-socket\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.383508 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.383413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-data\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.383672 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.383651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-certs\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.384097 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.384071 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istiod-ca-cert\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.385326 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.385293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-envoy\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.385601 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.385581 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-podinfo\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.390162 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.390130 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-token\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.390330 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.390311 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-575zm\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-kube-api-access-575zm\") pod \"e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.504532 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.504497 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:01.538152 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.538081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:01.651447 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.651417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl"] Jul 16 17:46:01.654850 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:46:01.654807 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ad82bf_0660_411d_aa0f_d3dfcf7490e4.slice/crio-2b190cac9d385ec93603568aaedc9efe02f8a62d332d1baa08d935978ca7c544 WatchSource:0}: Error finding container 2b190cac9d385ec93603568aaedc9efe02f8a62d332d1baa08d935978ca7c544: Status 404 returned error can't find the container with id 2b190cac9d385ec93603568aaedc9efe02f8a62d332d1baa08d935978ca7c544 Jul 16 17:46:01.657350 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.657317 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:46:01.657471 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.657381 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:46:01.657471 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.657408 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 16 17:46:01.762500 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:01.762463 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:02.213904 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.213866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:02.313684 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.313654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:02.354568 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.354532 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" event={"ID":"62ad82bf-0660-411d-aa0f-d3dfcf7490e4","Type":"ContainerStarted","Data":"b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6"} Jul 16 17:46:02.354778 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.354596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" event={"ID":"62ad82bf-0660-411d-aa0f-d3dfcf7490e4","Type":"ContainerStarted","Data":"2b190cac9d385ec93603568aaedc9efe02f8a62d332d1baa08d935978ca7c544"} Jul 16 17:46:02.378724 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.378633 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" podStartSLOduration=1.378598893 podStartE2EDuration="1.378598893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:46:02.375841909 +0000 UTC m=+1585.697058089" watchObservedRunningTime="2026-07-16 17:46:02.378598893 +0000 UTC m=+1585.699815054" Jul 16 17:46:02.422077 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.422046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:02.505264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.505181 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:02.506745 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.506717 2579 patch_prober.go:28] interesting pod/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 16 17:46:02.506905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:02.506765 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" podUID="62ad82bf-0660-411d-aa0f-d3dfcf7490e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 16 17:46:03.509424 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:03.509396 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:04.306039 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:04.306004 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:04.364916 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:04.364886 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:04.365939 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:04.365920 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:05.382165 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:05.382132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:46:07.083892 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:07.083859 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl"] Jul 16 17:46:07.105578 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:07.105546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:07.382585 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:07.382536 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" podUID="62ad82bf-0660-411d-aa0f-d3dfcf7490e4" containerName="istio-proxy" containerID="cri-o://b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6" gracePeriod=30 Jul 16 17:46:08.170865 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:08.170831 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:08.776351 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:08.776322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:12.991558 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:12.991519 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:13.118998 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.118965 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:13.145648 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.145579 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:13.212412 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.212380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:13.291905 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.291876 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:13.305023 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.304997 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-certs\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305042 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-podinfo\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305100 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-data\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305129 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-envoy\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305155 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-token\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305181 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istiod-ca-cert\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305516 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305216 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-credential-socket\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305516 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305242 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-575zm\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-kube-api-access-575zm\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305516 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305305 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:46:13.305516 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305315 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-socket\") pod \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\" (UID: \"62ad82bf-0660-411d-aa0f-d3dfcf7490e4\") " Jul 16 17:46:13.305720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305532 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:46:13.305720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305595 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:46:13.305720 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305626 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 17:46:13.305910 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305781 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istiod-ca-cert\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.305910 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305801 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-credential-socket\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.305910 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305850 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-socket\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.305910 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.305866 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-workload-certs\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.306422 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.306092 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:46:13.307948 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.307910 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:46:13.307948 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.307920 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:46:13.308080 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.307957 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 17:46:13.308080 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.307967 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-kube-api-access-575zm" (OuterVolumeSpecName: "kube-api-access-575zm") pod "62ad82bf-0660-411d-aa0f-d3dfcf7490e4" (UID: "62ad82bf-0660-411d-aa0f-d3dfcf7490e4"). InnerVolumeSpecName "kube-api-access-575zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:46:13.373508 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.373472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:13.406618 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.406502 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-envoy\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.406618 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.406537 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-token\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.406618 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.406550 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-575zm\" (UniqueName: \"kubernetes.io/projected/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-kube-api-access-575zm\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.406618 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.406571 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-podinfo\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.406618 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.406584 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ad82bf-0660-411d-aa0f-d3dfcf7490e4-istio-data\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:46:13.413914 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.413880 2579 generic.go:356] "Generic (PLEG): container finished" podID="62ad82bf-0660-411d-aa0f-d3dfcf7490e4" containerID="b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6" exitCode=0 Jul 16 17:46:13.414091 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.413928 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" Jul 16 17:46:13.414091 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.413961 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" event={"ID":"62ad82bf-0660-411d-aa0f-d3dfcf7490e4","Type":"ContainerDied","Data":"b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6"} Jul 16 17:46:13.414091 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.414022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl" event={"ID":"62ad82bf-0660-411d-aa0f-d3dfcf7490e4","Type":"ContainerDied","Data":"2b190cac9d385ec93603568aaedc9efe02f8a62d332d1baa08d935978ca7c544"} Jul 16 17:46:13.414091 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.414055 2579 scope.go:117] "RemoveContainer" containerID="b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6" Jul 16 17:46:13.424406 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.424389 2579 scope.go:117] "RemoveContainer" containerID="b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6" Jul 16 17:46:13.424748 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:46:13.424727 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6\": container with ID starting with b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6 not found: ID does not exist" containerID="b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6" Jul 16 17:46:13.424835 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.424759 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6"} err="failed to get container status \"b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6\": rpc error: code = NotFound desc = could not find container \"b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6\": container with ID starting with b53f6f1a804bd187973c76e3877929c69e65889420405ae9e0ebaed8bbc294d6 not found: ID does not exist" Jul 16 17:46:13.435594 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.435562 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl"] Jul 16 17:46:13.441226 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.441195 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:13.442695 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.442672 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-bc4fabbb-gw-openshift-default-5bf7b56f9-572vl"] Jul 16 17:46:13.664931 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.664839 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:13.830856 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.830803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:13.930767 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:13.930666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:15.219442 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:15.219409 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62ad82bf-0660-411d-aa0f-d3dfcf7490e4" path="/var/lib/kubelet/pods/62ad82bf-0660-411d-aa0f-d3dfcf7490e4/volumes" Jul 16 17:46:16.900056 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:16.899991 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:17.578315 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:17.578280 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:46:18.824966 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:18.824928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:18.929792 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:18.929754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:20.280492 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:20.280454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:24.902730 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:24.902688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:24.989615 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:24.989574 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:46:24.998998 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:24.998965 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:25.431877 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:25.431846 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:25.531208 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:25.531172 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:25.690476 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:25.690393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:27.082372 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:27.082335 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:32.991438 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:32.991363 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:33.098694 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:33.098664 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:33.193963 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:33.193914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:33.290462 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:33.290380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:33.703186 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:33.703154 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:46:59.695377 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:46:59.695339 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:05.493999 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:05.493961 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:05.601194 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:05.601156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:05.698117 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:05.698086 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:21.597399 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:21.597357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:27.392050 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:27.392014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:27.472734 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:27.472704 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:27.569267 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:27.569234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:38.121022 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:38.120986 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:38.932367 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:38.932332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:44.706264 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:44.706226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:44.781112 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:44.781074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:44.870939 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:44.870905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:44.972457 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:44.972377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:45.786439 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:45.786401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:45.883529 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:45.883489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:45.983396 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:45.983365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:47.570717 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:47.570682 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:47.991696 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:47.991661 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:47:53.384459 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:53.384405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:53.485730 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:53.485699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:54.063178 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:54.063137 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:58.283282 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:58.283244 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:47:59.791582 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:59.791494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:47:59.892747 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:47:59.892711 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:00.034275 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:00.034236 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:00.332148 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:00.332104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:00.701141 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:00.701100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:02.088241 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:02.088208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:02.192397 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:02.192366 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:02.353093 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:02.352995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:02.813565 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:02.813528 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:02.910917 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:02.910879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:07.595121 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:07.595079 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:08.293400 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:08.293363 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:08.387355 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:08.387321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:08.728048 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:08.728014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:10.137718 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:10.137679 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:48:14.338585 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:14.338523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:14.441107 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:14.441055 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:15.113519 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:15.113483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:20.721981 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:20.721934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:20.794670 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:20.794637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:20.999255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:20.999160 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.232747 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:21.232711 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.365780 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:21.365745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.467000 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:21.466960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:21.603053 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:21.603025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:23.677155 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:23.677119 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:48:27.263027 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:27.262990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:27.366786 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:27.366748 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:27.461586 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:27.461549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:27.620379 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:27.620348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:33.181135 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:33.181104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:33.280880 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:33.280841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:40.866663 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:40.866629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:40.964627 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:40.964592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:41.064376 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:41.064334 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:41.764203 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:41.764164 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:41.877655 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:41.877617 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:42.044282 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:42.044197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:43.373041 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:43.373005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:45.374716 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:45.374675 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:48:49.204857 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:49.204800 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:49.305562 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:49.305525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:49.890129 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:49.890097 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:55.849316 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:55.849283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:55.951037 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:55.950996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:56.053327 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:56.053297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:48:56.880692 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:48:56.880658 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:49:01.235104 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:01.235062 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:01.335934 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:01.335892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:06.569617 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:06.569584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:06.911797 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:06.911727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:27.947976 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:27.947940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:33.618997 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:33.618915 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:33.686538 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:33.686503 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:33.975435 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:33.975354 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:34.288443 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:34.288352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:34.422966 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:34.422933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:36.565608 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:36.565572 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:36.694380 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:36.694340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:36.856079 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:36.855992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:37.169096 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:37.169060 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:37.323771 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:37.323740 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:49:37.327556 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:37.327528 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:49:37.335036 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:37.335014 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:49:37.337984 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:37.337956 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:49:37.413806 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:37.413770 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:37.513736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:37.513653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:42.079623 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:42.079590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:42.427338 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:42.427301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:42.747222 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:42.747124 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:43.018240 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:43.018159 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:44.694766 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:44.694730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:44.788124 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:44.788088 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:44.883942 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:44.883905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:45.035129 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:45.035027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:45.323415 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:45.323317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:45.425919 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:45.425872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:46.077526 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:46.077492 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:49:50.096049 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:50.096009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:54.330979 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:54.330934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:58.835067 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:58.835036 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:58.935652 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:58.935618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:49:59.425124 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:49:59.425084 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:50:06.018723 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:06.018682 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:06.114998 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:06.114962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:25.029946 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:25.029908 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:29.378108 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:29.378076 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:50:43.487343 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:43.487284 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:44.377523 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:44.377491 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:44.577054 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:44.577018 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:50:44.860748 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:44.860661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:49.941638 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:49.941601 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:50:57.482224 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:50:57.482188 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:51:06.816671 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:06.816630 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:26.883715 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:26.883684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:28.204576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:28.204540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:30.580697 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:30.580662 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:51:33.844588 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:33.844553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:33.950384 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:33.950355 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:34.147160 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:34.147124 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:34.361116 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:34.361081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:34.721936 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:34.721901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:35.041878 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:35.041779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:35.284175 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:35.284134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:37.222915 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:37.222879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:37.312326 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:37.312290 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:37.385467 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:37.385433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:37.530495 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:37.530401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:37.901140 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:37.901098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:38.001973 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:38.001929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:42.714323 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:42.714289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:43.162981 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:43.162946 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:43.503388 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:43.503305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:43.649413 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:43.649373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:44.682708 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:44.682671 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:51:45.274860 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:45.274806 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:45.363675 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:45.363645 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:45.430487 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:45.430455 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:45.967584 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:45.967534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:46.066663 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:46.066629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:46.166924 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:46.166888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:50.793463 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:50.793420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:57.380229 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:57.380188 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:51:58.697598 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:58.697552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:58.797046 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:58.797007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:51:59.172141 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:51:59.172102 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:04.810885 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:04.810808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:06.972500 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:06.972456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:07.074298 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:07.074236 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:10.259293 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:10.259225 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:10.332440 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:10.332367 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:10.521922 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:10.521765 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:10.750250 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:10.750208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:11.231045 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:11.231014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:14.677865 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:14.677812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:52:14.972612 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:14.972497 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:17.350619 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:17.350580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:22.905045 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:22.905007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:23.013896 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:23.013850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:23.206001 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:23.205905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:23.444682 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:23.444598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:23.803033 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:23.803003 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:24.119856 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:24.119803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:24.373912 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:24.373801 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:26.495896 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:26.495835 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:26.578257 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:26.578208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:26.651378 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:26.651343 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:26.828300 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:26.828220 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:27.132020 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:27.131963 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:27.231018 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:27.230988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:27.887501 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:27.887467 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:52:30.021197 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:30.021090 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:32.074328 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:32.074293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:32.388706 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:32.388670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:32.826728 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:32.826637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:33.057616 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:33.057587 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:34.582227 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:34.582198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:34.710461 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:34.710424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:34.892195 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:34.892159 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:34.989255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:34.989225 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:35.382903 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:35.382870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:35.481460 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:35.481407 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:38.780464 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:38.780426 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:52:40.087658 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:40.087606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:47.835405 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:47.835345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:47.935241 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:47.935206 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:55.718451 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:55.718412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:56.097358 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:56.097267 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:56.197724 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:56.197691 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:52:59.500696 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:52:59.500659 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:53:32.715781 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:53:32.715733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:53:36.677124 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:53:36.677086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:54:01.947885 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:01.947780 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:54:02.055571 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:02.055539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:54:02.676608 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:02.676568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:54:19.335605 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:19.335569 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:54:37.355229 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:37.355198 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:54:37.358375 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:37.358355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:54:37.366735 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:37.366707 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:54:37.369929 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:37.369909 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:54:38.379753 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:38.379721 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:54:41.091175 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:41.091142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:54:54.184496 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:54:54.184459 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:55:14.275142 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:55:14.275101 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:55:30.383296 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:55:30.383214 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:55:53.083498 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:55:53.083466 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:55:57.314170 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:55:57.314132 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:55:58.203973 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:55:58.203937 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:05.135669 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:56:05.135633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:12.681993 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:56:12.681958 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:56:18.532226 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:56:18.532191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:28.632753 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:56:28.632720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:56:33.387721 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:56:33.387682 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:57:06.581603 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:06.581559 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:57:16.761077 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:16.761039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:16.861336 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:16.861285 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:22.746248 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:22.746208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:23.503538 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:23.503504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:25.618498 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:25.618428 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:30.981168 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:30.981132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:57:48.612547 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:48.612499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:48.710551 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:48.710499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:51.833392 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:51.833348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:56.677102 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:56.677061 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:57:56.797139 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:56.797094 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:57:56.896968 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:57:56.896933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:58:26.785589 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:26.785551 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:58:44.189259 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:44.189168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:58:50.432933 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:50.432895 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:58:51.247434 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:51.247398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:58:52.414755 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.414709 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7532-140630975458224"] Jul 16 17:58:52.415149 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.415137 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ad82bf-0660-411d-aa0f-d3dfcf7490e4" containerName="istio-proxy" Jul 16 17:58:52.415149 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.415150 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ad82bf-0660-411d-aa0f-d3dfcf7490e4" containerName="istio-proxy" Jul 16 17:58:52.415231 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.415211 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ad82bf-0660-411d-aa0f-d3dfcf7490e4" containerName="istio-proxy" Jul 16 17:58:52.418333 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.418316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:52.420216 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.420190 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w69fq\"" Jul 16 17:58:52.424167 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.424143 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630975458224"] Jul 16 17:58:52.462194 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.462155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6ls5\" (UniqueName: \"kubernetes.io/projected/a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0-kube-api-access-r6ls5\") pod \"test-curl-7532-140630975458224\" (UID: \"a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0\") " pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:52.562917 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.562876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ls5\" (UniqueName: \"kubernetes.io/projected/a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0-kube-api-access-r6ls5\") pod \"test-curl-7532-140630975458224\" (UID: \"a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0\") " pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:52.570845 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.570804 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6ls5\" (UniqueName: \"kubernetes.io/projected/a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0-kube-api-access-r6ls5\") pod \"test-curl-7532-140630975458224\" (UID: \"a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0\") " pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:52.728867 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.728752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:52.866051 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.866016 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630975458224"] Jul 16 17:58:52.868307 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:58:52.868274 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0ff81e4_cea7_4cae_90e8_2d5b61b5c6a0.slice/crio-933c9dd8f2587727553bceb2af58259bce3e2810003d3494dcd722cd2ea2f2d1 WatchSource:0}: Error finding container 933c9dd8f2587727553bceb2af58259bce3e2810003d3494dcd722cd2ea2f2d1: Status 404 returned error can't find the container with id 933c9dd8f2587727553bceb2af58259bce3e2810003d3494dcd722cd2ea2f2d1 Jul 16 17:58:52.869745 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:52.869726 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:58:53.346299 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:53.346260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630975458224" event={"ID":"a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0","Type":"ContainerStarted","Data":"933c9dd8f2587727553bceb2af58259bce3e2810003d3494dcd722cd2ea2f2d1"} Jul 16 17:58:54.353151 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:54.353116 2579 generic.go:356] "Generic (PLEG): container finished" podID="a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0" containerID="bd387b01bd28f0684afcf07f9134414244e89c19a3e13a7f112fc849baad0930" exitCode=0 Jul 16 17:58:54.353547 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:54.353194 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630975458224" event={"ID":"a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0","Type":"ContainerDied","Data":"bd387b01bd28f0684afcf07f9134414244e89c19a3e13a7f112fc849baad0930"} Jul 16 17:58:55.503081 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.503057 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:55.524670 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.524639 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7532-140630975458224_a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0/test-curl-7532-140630975458224/0.log" Jul 16 17:58:55.553025 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.552992 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7532-140630975458224"] Jul 16 17:58:55.558813 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.558788 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7532-140630975458224"] Jul 16 17:58:55.592342 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.592306 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6ls5\" (UniqueName: \"kubernetes.io/projected/a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0-kube-api-access-r6ls5\") pod \"a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0\" (UID: \"a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0\") " Jul 16 17:58:55.594551 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.594529 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0-kube-api-access-r6ls5" (OuterVolumeSpecName: "kube-api-access-r6ls5") pod "a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0" (UID: "a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0"). InnerVolumeSpecName "kube-api-access-r6ls5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:58:55.681226 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.681184 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7532-140630974251824"] Jul 16 17:58:55.681659 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.681639 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0" containerName="test-curl-7532-140630975458224" Jul 16 17:58:55.681748 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.681661 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0" containerName="test-curl-7532-140630975458224" Jul 16 17:58:55.681811 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.681801 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0" containerName="test-curl-7532-140630975458224" Jul 16 17:58:55.684992 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.684971 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630974251824" Jul 16 17:58:55.689724 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.689702 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630974251824"] Jul 16 17:58:55.693366 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.693342 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6ls5\" (UniqueName: \"kubernetes.io/projected/a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0-kube-api-access-r6ls5\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:58:55.794242 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.794204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzhj\" (UniqueName: \"kubernetes.io/projected/88995cdd-eced-41e6-9120-8a04f9dd140a-kube-api-access-qpzhj\") pod \"test-curl-7532-140630974251824\" (UID: \"88995cdd-eced-41e6-9120-8a04f9dd140a\") " pod="opendatahub/test-curl-7532-140630974251824" Jul 16 17:58:55.895657 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.895610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzhj\" (UniqueName: \"kubernetes.io/projected/88995cdd-eced-41e6-9120-8a04f9dd140a-kube-api-access-qpzhj\") pod \"test-curl-7532-140630974251824\" (UID: \"88995cdd-eced-41e6-9120-8a04f9dd140a\") " pod="opendatahub/test-curl-7532-140630974251824" Jul 16 17:58:55.903185 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.903156 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzhj\" (UniqueName: \"kubernetes.io/projected/88995cdd-eced-41e6-9120-8a04f9dd140a-kube-api-access-qpzhj\") pod \"test-curl-7532-140630974251824\" (UID: \"88995cdd-eced-41e6-9120-8a04f9dd140a\") " pod="opendatahub/test-curl-7532-140630974251824" Jul 16 17:58:55.994981 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:55.994875 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630974251824" Jul 16 17:58:56.129298 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:56.129080 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630974251824"] Jul 16 17:58:56.131588 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:58:56.131562 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88995cdd_eced_41e6_9120_8a04f9dd140a.slice/crio-bdc7fd0baee8cc53fb9a40684fb59bc19a2b8dfcd2bf2cd431def7787d3b4a9e WatchSource:0}: Error finding container bdc7fd0baee8cc53fb9a40684fb59bc19a2b8dfcd2bf2cd431def7787d3b4a9e: Status 404 returned error can't find the container with id bdc7fd0baee8cc53fb9a40684fb59bc19a2b8dfcd2bf2cd431def7787d3b4a9e Jul 16 17:58:56.364870 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:56.364841 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:56.365053 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:56.364869 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="933c9dd8f2587727553bceb2af58259bce3e2810003d3494dcd722cd2ea2f2d1" Jul 16 17:58:56.366014 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:56.365986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630974251824" event={"ID":"88995cdd-eced-41e6-9120-8a04f9dd140a","Type":"ContainerStarted","Data":"bdc7fd0baee8cc53fb9a40684fb59bc19a2b8dfcd2bf2cd431def7787d3b4a9e"} Jul 16 17:58:56.375092 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:58:56.375068 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7532-140630975458224\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0" pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:57.217048 ip-10-0-131-79 kubenswrapper[2579]: E0716 17:58:57.217003 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7532-140630975458224\" is forbidden: User \"system:node:ip-10-0-131-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-79.ec2.internal' and this object" podUID="a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0" pod="opendatahub/test-curl-7532-140630975458224" Jul 16 17:58:57.219202 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:57.219178 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0" path="/var/lib/kubelet/pods/a0ff81e4-cea7-4cae-90e8-2d5b61b5c6a0/volumes" Jul 16 17:58:57.372246 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:57.372213 2579 generic.go:356] "Generic (PLEG): container finished" podID="88995cdd-eced-41e6-9120-8a04f9dd140a" containerID="5e9730911a275faa0e822f6de21a54684bffeb05f978028d3007fdf0f7dde1d1" exitCode=0 Jul 16 17:58:57.372390 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:57.372263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630974251824" event={"ID":"88995cdd-eced-41e6-9120-8a04f9dd140a","Type":"ContainerDied","Data":"5e9730911a275faa0e822f6de21a54684bffeb05f978028d3007fdf0f7dde1d1"} Jul 16 17:58:58.523865 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.523839 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630974251824" Jul 16 17:58:58.543358 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.543328 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7532-140630974251824_88995cdd-eced-41e6-9120-8a04f9dd140a/test-curl-7532-140630974251824/0.log" Jul 16 17:58:58.570914 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.570881 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7532-140630974251824"] Jul 16 17:58:58.572778 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.572758 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7532-140630974251824"] Jul 16 17:58:58.622539 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.622499 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpzhj\" (UniqueName: \"kubernetes.io/projected/88995cdd-eced-41e6-9120-8a04f9dd140a-kube-api-access-qpzhj\") pod \"88995cdd-eced-41e6-9120-8a04f9dd140a\" (UID: \"88995cdd-eced-41e6-9120-8a04f9dd140a\") " Jul 16 17:58:58.624751 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.624711 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88995cdd-eced-41e6-9120-8a04f9dd140a-kube-api-access-qpzhj" (OuterVolumeSpecName: "kube-api-access-qpzhj") pod "88995cdd-eced-41e6-9120-8a04f9dd140a" (UID: "88995cdd-eced-41e6-9120-8a04f9dd140a"). InnerVolumeSpecName "kube-api-access-qpzhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:58:58.724071 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.724032 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpzhj\" (UniqueName: \"kubernetes.io/projected/88995cdd-eced-41e6-9120-8a04f9dd140a-kube-api-access-qpzhj\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:58:58.735181 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.735142 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:58:58.735618 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.735598 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88995cdd-eced-41e6-9120-8a04f9dd140a" containerName="test-curl-7532-140630974251824" Jul 16 17:58:58.735723 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.735621 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="88995cdd-eced-41e6-9120-8a04f9dd140a" containerName="test-curl-7532-140630974251824" Jul 16 17:58:58.735785 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.735725 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="88995cdd-eced-41e6-9120-8a04f9dd140a" containerName="test-curl-7532-140630974251824" Jul 16 17:58:58.738879 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.738858 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:58:58.744865 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.744811 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:58:58.824830 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.824792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glfch\" (UniqueName: \"kubernetes.io/projected/84788338-e9b2-482d-9dd8-604611abc050-kube-api-access-glfch\") pod \"test-curl-7532-140630978305456\" (UID: \"84788338-e9b2-482d-9dd8-604611abc050\") " pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:58:58.926125 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.926024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glfch\" (UniqueName: \"kubernetes.io/projected/84788338-e9b2-482d-9dd8-604611abc050-kube-api-access-glfch\") pod \"test-curl-7532-140630978305456\" (UID: \"84788338-e9b2-482d-9dd8-604611abc050\") " pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:58:58.934670 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:58.934643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glfch\" (UniqueName: \"kubernetes.io/projected/84788338-e9b2-482d-9dd8-604611abc050-kube-api-access-glfch\") pod \"test-curl-7532-140630978305456\" (UID: \"84788338-e9b2-482d-9dd8-604611abc050\") " pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:58:59.049286 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:59.049249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:58:59.185634 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:59.185605 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:58:59.187343 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:58:59.187314 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84788338_e9b2_482d_9dd8_604611abc050.slice/crio-5edc08cb017120ef07ac3bbc33a5e71d1ea047e597ea8ab702c542112f180167 WatchSource:0}: Error finding container 5edc08cb017120ef07ac3bbc33a5e71d1ea047e597ea8ab702c542112f180167: Status 404 returned error can't find the container with id 5edc08cb017120ef07ac3bbc33a5e71d1ea047e597ea8ab702c542112f180167 Jul 16 17:58:59.224444 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:59.224406 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88995cdd-eced-41e6-9120-8a04f9dd140a" path="/var/lib/kubelet/pods/88995cdd-eced-41e6-9120-8a04f9dd140a/volumes" Jul 16 17:58:59.384237 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:59.384198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630978305456" event={"ID":"84788338-e9b2-482d-9dd8-604611abc050","Type":"ContainerStarted","Data":"5edc08cb017120ef07ac3bbc33a5e71d1ea047e597ea8ab702c542112f180167"} Jul 16 17:58:59.385448 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:59.385423 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630974251824" Jul 16 17:58:59.385448 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:58:59.385444 2579 scope.go:117] "RemoveContainer" containerID="5e9730911a275faa0e822f6de21a54684bffeb05f978028d3007fdf0f7dde1d1" Jul 16 17:59:00.392262 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:00.392219 2579 generic.go:356] "Generic (PLEG): container finished" podID="84788338-e9b2-482d-9dd8-604611abc050" containerID="9d5d490e721a0bc978a4257eaea2b10b8e2dbd431697643878731a5cb9b0ddf9" exitCode=0 Jul 16 17:59:00.392702 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:00.392305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630978305456" event={"ID":"84788338-e9b2-482d-9dd8-604611abc050","Type":"ContainerDied","Data":"9d5d490e721a0bc978a4257eaea2b10b8e2dbd431697643878731a5cb9b0ddf9"} Jul 16 17:59:01.536586 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.536564 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:01.558090 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.558064 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7532-140630978305456_84788338-e9b2-482d-9dd8-604611abc050/test-curl-7532-140630978305456/0.log" Jul 16 17:59:01.585336 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.585304 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:59:01.591589 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.591565 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:59:01.650469 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.650385 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glfch\" (UniqueName: \"kubernetes.io/projected/84788338-e9b2-482d-9dd8-604611abc050-kube-api-access-glfch\") pod \"84788338-e9b2-482d-9dd8-604611abc050\" (UID: \"84788338-e9b2-482d-9dd8-604611abc050\") " Jul 16 17:59:01.652466 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.652437 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84788338-e9b2-482d-9dd8-604611abc050-kube-api-access-glfch" (OuterVolumeSpecName: "kube-api-access-glfch") pod "84788338-e9b2-482d-9dd8-604611abc050" (UID: "84788338-e9b2-482d-9dd8-604611abc050"). InnerVolumeSpecName "kube-api-access-glfch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:59:01.739042 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.739002 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:59:01.739611 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.739593 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84788338-e9b2-482d-9dd8-604611abc050" containerName="test-curl-7532-140630978305456" Jul 16 17:59:01.739666 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.739616 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="84788338-e9b2-482d-9dd8-604611abc050" containerName="test-curl-7532-140630978305456" Jul 16 17:59:01.739772 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.739760 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="84788338-e9b2-482d-9dd8-604611abc050" containerName="test-curl-7532-140630978305456" Jul 16 17:59:01.743164 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.743146 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:01.748155 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.748124 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:59:01.751179 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.751111 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glfch\" (UniqueName: \"kubernetes.io/projected/84788338-e9b2-482d-9dd8-604611abc050-kube-api-access-glfch\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:59:01.852380 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.852351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnppp\" (UniqueName: \"kubernetes.io/projected/78492302-e90e-4581-8745-155cfab76d7f-kube-api-access-xnppp\") pod \"test-curl-7532-140630978305456\" (UID: \"78492302-e90e-4581-8745-155cfab76d7f\") " pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:01.953522 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.953434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnppp\" (UniqueName: \"kubernetes.io/projected/78492302-e90e-4581-8745-155cfab76d7f-kube-api-access-xnppp\") pod \"test-curl-7532-140630978305456\" (UID: \"78492302-e90e-4581-8745-155cfab76d7f\") " pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:01.962986 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:01.962953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnppp\" (UniqueName: \"kubernetes.io/projected/78492302-e90e-4581-8745-155cfab76d7f-kube-api-access-xnppp\") pod \"test-curl-7532-140630978305456\" (UID: \"78492302-e90e-4581-8745-155cfab76d7f\") " pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:02.054660 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:02.054625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:02.188186 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:02.188154 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:59:02.191514 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:59:02.191484 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78492302_e90e_4581_8745_155cfab76d7f.slice/crio-e364d3c9b6d2f391913817ef3aeb186e48df43fcd3242e13840db77ff1332b92 WatchSource:0}: Error finding container e364d3c9b6d2f391913817ef3aeb186e48df43fcd3242e13840db77ff1332b92: Status 404 returned error can't find the container with id e364d3c9b6d2f391913817ef3aeb186e48df43fcd3242e13840db77ff1332b92 Jul 16 17:59:02.404750 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:02.404712 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630978305456" event={"ID":"78492302-e90e-4581-8745-155cfab76d7f","Type":"ContainerStarted","Data":"e364d3c9b6d2f391913817ef3aeb186e48df43fcd3242e13840db77ff1332b92"} Jul 16 17:59:02.405925 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:02.405907 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:02.405999 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:02.405937 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5edc08cb017120ef07ac3bbc33a5e71d1ea047e597ea8ab702c542112f180167" Jul 16 17:59:02.419306 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:02.419275 2579 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7532-140630978305456" oldPodUID="84788338-e9b2-482d-9dd8-604611abc050" podUID="78492302-e90e-4581-8745-155cfab76d7f" Jul 16 17:59:02.673568 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:02.673531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:02.775047 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:02.774956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:03.220044 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:03.220012 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84788338-e9b2-482d-9dd8-604611abc050" path="/var/lib/kubelet/pods/84788338-e9b2-482d-9dd8-604611abc050/volumes" Jul 16 17:59:03.413350 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:03.413313 2579 generic.go:356] "Generic (PLEG): container finished" podID="78492302-e90e-4581-8745-155cfab76d7f" containerID="131767335ee922b74d05b5cfa360fd7908bed6f4949efecbefde5617c7411a98" exitCode=0 Jul 16 17:59:03.413515 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:03.413400 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630978305456" event={"ID":"78492302-e90e-4581-8745-155cfab76d7f","Type":"ContainerDied","Data":"131767335ee922b74d05b5cfa360fd7908bed6f4949efecbefde5617c7411a98"} Jul 16 17:59:04.081381 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.081346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:04.510094 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.510057 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:59:04.562751 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.562721 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:04.582440 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.582413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7532-140630978305456_78492302-e90e-4581-8745-155cfab76d7f/test-curl-7532-140630978305456/0.log" Jul 16 17:59:04.612533 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.612500 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:59:04.616304 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.616278 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7532-140630978305456"] Jul 16 17:59:04.679562 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.679475 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnppp\" (UniqueName: \"kubernetes.io/projected/78492302-e90e-4581-8745-155cfab76d7f-kube-api-access-xnppp\") pod \"78492302-e90e-4581-8745-155cfab76d7f\" (UID: \"78492302-e90e-4581-8745-155cfab76d7f\") " Jul 16 17:59:04.681599 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.681574 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78492302-e90e-4581-8745-155cfab76d7f-kube-api-access-xnppp" (OuterVolumeSpecName: "kube-api-access-xnppp") pod "78492302-e90e-4581-8745-155cfab76d7f" (UID: "78492302-e90e-4581-8745-155cfab76d7f"). InnerVolumeSpecName "kube-api-access-xnppp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:59:04.744297 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.744267 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:04.744660 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.744647 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78492302-e90e-4581-8745-155cfab76d7f" containerName="test-curl-7532-140630978305456" Jul 16 17:59:04.744703 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.744662 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="78492302-e90e-4581-8745-155cfab76d7f" containerName="test-curl-7532-140630978305456" Jul 16 17:59:04.744753 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.744744 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="78492302-e90e-4581-8745-155cfab76d7f" containerName="test-curl-7532-140630978305456" Jul 16 17:59:04.748130 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.748108 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:04.756450 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.756425 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:04.780549 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.780521 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnppp\" (UniqueName: \"kubernetes.io/projected/78492302-e90e-4581-8745-155cfab76d7f-kube-api-access-xnppp\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:59:04.881194 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.881151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzfws\" (UniqueName: \"kubernetes.io/projected/f1a4435a-c4d1-4f0a-8e73-db7839609c77-kube-api-access-fzfws\") pod \"test-curl-7532-140630977884640\" (UID: \"f1a4435a-c4d1-4f0a-8e73-db7839609c77\") " pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:04.982577 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.982480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzfws\" (UniqueName: \"kubernetes.io/projected/f1a4435a-c4d1-4f0a-8e73-db7839609c77-kube-api-access-fzfws\") pod \"test-curl-7532-140630977884640\" (UID: \"f1a4435a-c4d1-4f0a-8e73-db7839609c77\") " pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:04.991512 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:04.991482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzfws\" (UniqueName: \"kubernetes.io/projected/f1a4435a-c4d1-4f0a-8e73-db7839609c77-kube-api-access-fzfws\") pod \"test-curl-7532-140630977884640\" (UID: \"f1a4435a-c4d1-4f0a-8e73-db7839609c77\") " pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:05.058417 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:05.058378 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:05.195998 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:05.195967 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:05.197610 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:59:05.197584 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1a4435a_c4d1_4f0a_8e73_db7839609c77.slice/crio-9909e21e6519019004a38ee83829fc8d2d54f140b437b1d56c9f0c03de3cfd6d WatchSource:0}: Error finding container 9909e21e6519019004a38ee83829fc8d2d54f140b437b1d56c9f0c03de3cfd6d: Status 404 returned error can't find the container with id 9909e21e6519019004a38ee83829fc8d2d54f140b437b1d56c9f0c03de3cfd6d Jul 16 17:59:05.219269 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:05.219240 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78492302-e90e-4581-8745-155cfab76d7f" path="/var/lib/kubelet/pods/78492302-e90e-4581-8745-155cfab76d7f/volumes" Jul 16 17:59:05.424746 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:05.424716 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630978305456" Jul 16 17:59:05.424746 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:05.424737 2579 scope.go:117] "RemoveContainer" containerID="131767335ee922b74d05b5cfa360fd7908bed6f4949efecbefde5617c7411a98" Jul 16 17:59:05.426145 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:05.426119 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630977884640" event={"ID":"f1a4435a-c4d1-4f0a-8e73-db7839609c77","Type":"ContainerStarted","Data":"9909e21e6519019004a38ee83829fc8d2d54f140b437b1d56c9f0c03de3cfd6d"} Jul 16 17:59:06.434395 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:06.434357 2579 generic.go:356] "Generic (PLEG): container finished" podID="f1a4435a-c4d1-4f0a-8e73-db7839609c77" containerID="b62c539344e7fc646c559bfeb0690994118d7458f1c1459643a8f536082f4130" exitCode=0 Jul 16 17:59:06.434865 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:06.434437 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630977884640" event={"ID":"f1a4435a-c4d1-4f0a-8e73-db7839609c77","Type":"ContainerDied","Data":"b62c539344e7fc646c559bfeb0690994118d7458f1c1459643a8f536082f4130"} Jul 16 17:59:07.581533 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.581507 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:07.601135 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.601105 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7532-140630977884640_f1a4435a-c4d1-4f0a-8e73-db7839609c77/test-curl-7532-140630977884640/0.log" Jul 16 17:59:07.627244 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.627208 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:07.629425 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.629394 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:07.708856 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.708803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzfws\" (UniqueName: \"kubernetes.io/projected/f1a4435a-c4d1-4f0a-8e73-db7839609c77-kube-api-access-fzfws\") pod \"f1a4435a-c4d1-4f0a-8e73-db7839609c77\" (UID: \"f1a4435a-c4d1-4f0a-8e73-db7839609c77\") " Jul 16 17:59:07.710698 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.710674 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1a4435a-c4d1-4f0a-8e73-db7839609c77-kube-api-access-fzfws" (OuterVolumeSpecName: "kube-api-access-fzfws") pod "f1a4435a-c4d1-4f0a-8e73-db7839609c77" (UID: "f1a4435a-c4d1-4f0a-8e73-db7839609c77"). InnerVolumeSpecName "kube-api-access-fzfws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:59:07.762038 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.759171 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:07.762038 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.760069 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1a4435a-c4d1-4f0a-8e73-db7839609c77" containerName="test-curl-7532-140630977884640" Jul 16 17:59:07.762038 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.760091 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1a4435a-c4d1-4f0a-8e73-db7839609c77" containerName="test-curl-7532-140630977884640" Jul 16 17:59:07.762038 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.760316 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1a4435a-c4d1-4f0a-8e73-db7839609c77" containerName="test-curl-7532-140630977884640" Jul 16 17:59:07.765575 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.765547 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:07.766716 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.766687 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:07.810229 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.810153 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzfws\" (UniqueName: \"kubernetes.io/projected/f1a4435a-c4d1-4f0a-8e73-db7839609c77-kube-api-access-fzfws\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:59:07.911453 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:07.911407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz65n\" (UniqueName: \"kubernetes.io/projected/d55a7517-ebd3-4042-9256-33e78b463491-kube-api-access-hz65n\") pod \"test-curl-7532-140630977884640\" (UID: \"d55a7517-ebd3-4042-9256-33e78b463491\") " pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:08.012854 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:08.012793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz65n\" (UniqueName: \"kubernetes.io/projected/d55a7517-ebd3-4042-9256-33e78b463491-kube-api-access-hz65n\") pod \"test-curl-7532-140630977884640\" (UID: \"d55a7517-ebd3-4042-9256-33e78b463491\") " pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:08.021191 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:08.021162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz65n\" (UniqueName: \"kubernetes.io/projected/d55a7517-ebd3-4042-9256-33e78b463491-kube-api-access-hz65n\") pod \"test-curl-7532-140630977884640\" (UID: \"d55a7517-ebd3-4042-9256-33e78b463491\") " pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:08.076256 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:08.076169 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:08.217619 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:08.217591 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:08.219721 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:59:08.219682 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd55a7517_ebd3_4042_9256_33e78b463491.slice/crio-a098e36c7081f03a101c7a597c70d4b2462d38241ec6887fcfb914be73b06248 WatchSource:0}: Error finding container a098e36c7081f03a101c7a597c70d4b2462d38241ec6887fcfb914be73b06248: Status 404 returned error can't find the container with id a098e36c7081f03a101c7a597c70d4b2462d38241ec6887fcfb914be73b06248 Jul 16 17:59:08.446216 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:08.446177 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630977884640" event={"ID":"d55a7517-ebd3-4042-9256-33e78b463491","Type":"ContainerStarted","Data":"a098e36c7081f03a101c7a597c70d4b2462d38241ec6887fcfb914be73b06248"} Jul 16 17:59:08.447432 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:08.447408 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9909e21e6519019004a38ee83829fc8d2d54f140b437b1d56c9f0c03de3cfd6d" Jul 16 17:59:08.447432 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:08.447419 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:08.458523 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:08.458499 2579 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7532-140630977884640" oldPodUID="f1a4435a-c4d1-4f0a-8e73-db7839609c77" podUID="d55a7517-ebd3-4042-9256-33e78b463491" Jul 16 17:59:09.222308 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:09.222270 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1a4435a-c4d1-4f0a-8e73-db7839609c77" path="/var/lib/kubelet/pods/f1a4435a-c4d1-4f0a-8e73-db7839609c77/volumes" Jul 16 17:59:09.454272 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:09.454231 2579 generic.go:356] "Generic (PLEG): container finished" podID="d55a7517-ebd3-4042-9256-33e78b463491" containerID="3dbc1eece00e63e7ea352f0e50587edfab6627696c60e93d7cfc468cf794bc4d" exitCode=0 Jul 16 17:59:09.454450 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:09.454313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7532-140630977884640" event={"ID":"d55a7517-ebd3-4042-9256-33e78b463491","Type":"ContainerDied","Data":"3dbc1eece00e63e7ea352f0e50587edfab6627696c60e93d7cfc468cf794bc4d"} Jul 16 17:59:10.066291 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:10.066253 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:10.604714 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:10.604692 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:10.624866 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:10.624839 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7532-140630977884640_d55a7517-ebd3-4042-9256-33e78b463491/test-curl-7532-140630977884640/0.log" Jul 16 17:59:10.648114 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:10.648077 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:10.649883 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:10.649858 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7532-140630977884640"] Jul 16 17:59:10.736986 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:10.736901 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz65n\" (UniqueName: \"kubernetes.io/projected/d55a7517-ebd3-4042-9256-33e78b463491-kube-api-access-hz65n\") pod \"d55a7517-ebd3-4042-9256-33e78b463491\" (UID: \"d55a7517-ebd3-4042-9256-33e78b463491\") " Jul 16 17:59:10.739268 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:10.739244 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d55a7517-ebd3-4042-9256-33e78b463491-kube-api-access-hz65n" (OuterVolumeSpecName: "kube-api-access-hz65n") pod "d55a7517-ebd3-4042-9256-33e78b463491" (UID: "d55a7517-ebd3-4042-9256-33e78b463491"). InnerVolumeSpecName "kube-api-access-hz65n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:59:10.838494 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:10.838456 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz65n\" (UniqueName: \"kubernetes.io/projected/d55a7517-ebd3-4042-9256-33e78b463491-kube-api-access-hz65n\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\"" Jul 16 17:59:11.211863 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:11.211800 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:11.218033 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:11.218003 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d55a7517-ebd3-4042-9256-33e78b463491" path="/var/lib/kubelet/pods/d55a7517-ebd3-4042-9256-33e78b463491/volumes" Jul 16 17:59:11.465575 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:11.465494 2579 scope.go:117] "RemoveContainer" containerID="3dbc1eece00e63e7ea352f0e50587edfab6627696c60e93d7cfc468cf794bc4d" Jul 16 17:59:11.465575 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:11.465515 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7532-140630977884640" Jul 16 17:59:17.529962 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:17.529913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:17.630403 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:17.630371 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:17.841218 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:17.841120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:18.049073 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:18.049039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:18.558075 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:18.558039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:21.576724 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:21.576688 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:59:24.737096 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:24.737059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:24.809219 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:24.809177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:25.060332 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:25.060246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:25.271919 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:25.271886 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:28.377119 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:28.377083 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:28.477980 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:28.477945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:32.044889 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:32.044861 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qb2gz_4d1548ad-ff25-40cc-b0e8-dd83b3cebe14/server/0.log" Jul 16 17:59:32.170445 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:32.170419 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8ffkf_036b64f1-63cb-4011-8b3b-b76452136ec0/manager/0.log" Jul 16 17:59:32.443874 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:32.443848 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-875d49b9b-j8gh4_93d99b1a-3b20-45a2-b312-80265eb856ed/copy-manifests/0.log" Jul 16 17:59:32.451661 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:32.451638 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-875d49b9b-j8gh4_93d99b1a-3b20-45a2-b312-80265eb856ed/manager/0.log" Jul 16 17:59:33.285406 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:33.285364 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4nprt"] Jul 16 17:59:34.382758 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:34.382717 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737050-47dq7_89a7c9a9-3149-4649-b258-ea205e2c1b95/cleanup/0.log" Jul 16 17:59:34.639233 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:34.639161 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-m62ll_6d7479b3-0732-4a3a-a10e-64791153db58/postgres/0.log" Jul 16 17:59:36.154393 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:36.154363 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dfrph_95d38b55-08f6-40b6-b38d-9a4d59f15273/manager/0.log" Jul 16 17:59:36.279026 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:36.279000 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wrmmn_6136f313-4f1b-4657-aff9-2dce758bc163/manager/0.log" Jul 16 17:59:36.530339 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:36.530250 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7m6dv_a4c05c32-b18d-4711-b43e-1c82a0ce2527/registry-server/0.log" Jul 16 17:59:36.657975 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:36.657945 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-x7xws_918c522c-3dce-422b-b46e-f03d9f126603/manager/0.log" Jul 16 17:59:36.782888 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:36.782795 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4nprt_5653d4b1-fc17-403d-b701-175ae7d68563/limitador/0.log" Jul 16 17:59:36.909472 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:36.909430 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dp57g_a1f95e1f-5e82-41a9-ac39-ddaf67814c24/manager/0.log" Jul 16 17:59:37.288606 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:37.288570 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678rjhbr_ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7/istio-proxy/0.log" Jul 16 17:59:37.387506 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:37.387476 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:59:37.390965 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:37.390941 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:59:37.399700 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:37.399679 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:59:37.402643 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:37.402624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zz6jt_aacf733f-6183-473f-84a6-943e9d5a2f3b/ovn-acl-logging/0.log" Jul 16 17:59:37.537167 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:37.537136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f558794c5-qqb8v_af7905d4-f5a2-4904-a047-084a36671315/kube-auth-proxy/0.log" Jul 16 17:59:37.795733 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:37.795700 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-f494m_cd11f485-e680-4f65-958a-57df6ed182d0/istio-proxy/1.log" Jul 16 17:59:38.162776 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:38.162744 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7bc4f64d-dt8h4_15b2c949-fa93-4a22-bb20-bdf8c250d20a/router/0.log" Jul 16 17:59:38.789798 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:38.789719 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9tc9d_75c63793-f3fb-4755-8526-8da460d76af6/main/0.log" Jul 16 17:59:44.701155 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.701119 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7r7x7/must-gather-bgnl9"] Jul 16 17:59:44.701537 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.701527 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d55a7517-ebd3-4042-9256-33e78b463491" containerName="test-curl-7532-140630977884640" Jul 16 17:59:44.701581 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.701539 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55a7517-ebd3-4042-9256-33e78b463491" containerName="test-curl-7532-140630977884640" Jul 16 17:59:44.701621 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.701610 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d55a7517-ebd3-4042-9256-33e78b463491" containerName="test-curl-7532-140630977884640" Jul 16 17:59:44.704802 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.704785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7r7x7/must-gather-bgnl9" Jul 16 17:59:44.706849 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.706810 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7r7x7\"/\"default-dockercfg-n24bv\"" Jul 16 17:59:44.706998 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.706897 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7r7x7\"/\"kube-root-ca.crt\"" Jul 16 17:59:44.706998 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.706860 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7r7x7\"/\"openshift-service-ca.crt\"" Jul 16 17:59:44.714482 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.714454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7r7x7/must-gather-bgnl9"] Jul 16 17:59:44.725392 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.725360 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:44.790260 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.790227 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" limit=1024 Jul 16 17:59:44.848511 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.848479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/042d42bc-6175-43c0-8905-aa3778ef1b82-must-gather-output\") pod \"must-gather-bgnl9\" (UID: \"042d42bc-6175-43c0-8905-aa3778ef1b82\") " pod="openshift-must-gather-7r7x7/must-gather-bgnl9" Jul 16 17:59:44.848678 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.848544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v96n\" (UniqueName: \"kubernetes.io/projected/042d42bc-6175-43c0-8905-aa3778ef1b82-kube-api-access-5v96n\") pod \"must-gather-bgnl9\" (UID: \"042d42bc-6175-43c0-8905-aa3778ef1b82\") " pod="openshift-must-gather-7r7x7/must-gather-bgnl9" Jul 16 17:59:44.950040 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.950005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v96n\" (UniqueName: \"kubernetes.io/projected/042d42bc-6175-43c0-8905-aa3778ef1b82-kube-api-access-5v96n\") pod \"must-gather-bgnl9\" (UID: \"042d42bc-6175-43c0-8905-aa3778ef1b82\") " pod="openshift-must-gather-7r7x7/must-gather-bgnl9" Jul 16 17:59:44.950253 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.950074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/042d42bc-6175-43c0-8905-aa3778ef1b82-must-gather-output\") pod \"must-gather-bgnl9\" (UID: \"042d42bc-6175-43c0-8905-aa3778ef1b82\") " pod="openshift-must-gather-7r7x7/must-gather-bgnl9" Jul 16 17:59:44.950403 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.950384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/042d42bc-6175-43c0-8905-aa3778ef1b82-must-gather-output\") pod \"must-gather-bgnl9\" (UID: \"042d42bc-6175-43c0-8905-aa3778ef1b82\") " pod="openshift-must-gather-7r7x7/must-gather-bgnl9" Jul 16 17:59:44.958867 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:44.958801 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v96n\" (UniqueName: \"kubernetes.io/projected/042d42bc-6175-43c0-8905-aa3778ef1b82-kube-api-access-5v96n\") pod \"must-gather-bgnl9\" (UID: \"042d42bc-6175-43c0-8905-aa3778ef1b82\") " pod="openshift-must-gather-7r7x7/must-gather-bgnl9" Jul 16 17:59:45.015055 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:45.015019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7r7x7/must-gather-bgnl9" Jul 16 17:59:45.159201 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:59:45.159172 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod042d42bc_6175_43c0_8905_aa3778ef1b82.slice/crio-e6d95692fd369b74d0db5f9f5fbeba14e37885756c440e9b79a825e0c39a1066 WatchSource:0}: Error finding container e6d95692fd369b74d0db5f9f5fbeba14e37885756c440e9b79a825e0c39a1066: Status 404 returned error can't find the container with id e6d95692fd369b74d0db5f9f5fbeba14e37885756c440e9b79a825e0c39a1066 Jul 16 17:59:45.163182 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:45.163159 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7r7x7/must-gather-bgnl9"] Jul 16 17:59:45.659997 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:45.659959 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7x7/must-gather-bgnl9" event={"ID":"042d42bc-6175-43c0-8905-aa3778ef1b82","Type":"ContainerStarted","Data":"e6d95692fd369b74d0db5f9f5fbeba14e37885756c440e9b79a825e0c39a1066"} Jul 16 17:59:46.671259 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:46.670372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7x7/must-gather-bgnl9" event={"ID":"042d42bc-6175-43c0-8905-aa3778ef1b82","Type":"ContainerStarted","Data":"d4a5a5ae64c6580346928cdc3bfe740d3737be54413add162c484c855199f5d5"} Jul 16 17:59:46.671259 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:46.670430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7x7/must-gather-bgnl9" event={"ID":"042d42bc-6175-43c0-8905-aa3778ef1b82","Type":"ContainerStarted","Data":"3a57677ba942c1648df42f6ac39616472aa1f969a34d6643a6a43f9b30a71dd1"} Jul 16 17:59:46.691255 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:46.691187 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7r7x7/must-gather-bgnl9" podStartSLOduration=1.8809782 podStartE2EDuration="2.691162291s" totalImagesPullingTime="810.184091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:59:46.688736127 +0000 UTC m=+2410.009952291" watchObservedRunningTime="2026-07-16 17:59:46.691162291 +0000 UTC m=+2410.012378455" Jul 16 17:59:47.643592 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:47.643542 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xjcjr_a0823601-1c1f-4a81-9212-3ef17f75c8e3/global-pull-secret-syncer/0.log" Jul 16 17:59:47.698691 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:47.698658 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bbhj5_eff0c9f7-e23e-4243-9ff7-e7db4655a4f5/konnectivity-agent/0.log" Jul 16 17:59:47.797379 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:47.797349 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-79.ec2.internal_822c3dc0fcba57a9f8441609f3e278a4/haproxy/0.log" Jul 16 17:59:53.632901 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:53.632865 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dfrph_95d38b55-08f6-40b6-b38d-9a4d59f15273/manager/0.log" Jul 16 17:59:53.663869 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:53.663839 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wrmmn_6136f313-4f1b-4657-aff9-2dce758bc163/manager/0.log" Jul 16 17:59:53.751155 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:53.751093 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7m6dv_a4c05c32-b18d-4711-b43e-1c82a0ce2527/registry-server/0.log" Jul 16 17:59:53.853024 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:53.852233 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-x7xws_918c522c-3dce-422b-b46e-f03d9f126603/manager/0.log" Jul 16 17:59:53.882032 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:53.881883 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4nprt_5653d4b1-fc17-403d-b701-175ae7d68563/limitador/0.log" Jul 16 17:59:53.962394 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:53.962298 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dp57g_a1f95e1f-5e82-41a9-ac39-ddaf67814c24/manager/0.log" Jul 16 17:59:55.660556 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:55.660477 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-9ffkm_16fadc42-e835-45ea-b1e3-9cd4656a73c8/cluster-monitoring-operator/0.log" Jul 16 17:59:55.823763 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:55.823724 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dnwb6_ece7f8fd-b8dc-4c06-8078-460b82fe3796/node-exporter/0.log" Jul 16 17:59:55.850846 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:55.846852 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dnwb6_ece7f8fd-b8dc-4c06-8078-460b82fe3796/kube-rbac-proxy/0.log" Jul 16 17:59:55.885803 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:55.885760 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dnwb6_ece7f8fd-b8dc-4c06-8078-460b82fe3796/init-textfile/0.log" Jul 16 17:59:56.404489 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:56.404456 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-8nkl7_43379f93-136c-4e66-9a77-a314683ca797/prometheus-operator-admission-webhook/0.log" Jul 16 17:59:57.795115 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:57.795087 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-xznv2_603a7915-9507-47fd-af9c-5bb6670da635/networking-console-plugin/0.log" Jul 16 17:59:57.921274 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:57.921235 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h"] Jul 16 17:59:57.927946 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:57.927917 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:57.937869 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:57.937838 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h"] Jul 16 17:59:58.091562 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.091463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-sys\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.091736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.091659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-lib-modules\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.091736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.091694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-podres\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.091736 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.091716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-proc\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.091914 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.091836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqkn\" (UniqueName: \"kubernetes.io/projected/bb698fb1-7c65-4cb3-837f-af17571ee5dd-kube-api-access-ncqkn\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.192576 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.192533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqkn\" (UniqueName: \"kubernetes.io/projected/bb698fb1-7c65-4cb3-837f-af17571ee5dd-kube-api-access-ncqkn\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.192779 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.192644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-sys\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.192779 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.192748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-lib-modules\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.192779 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.192770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-podres\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.192997 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.192791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-proc\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.192997 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.192942 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-proc\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.193332 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.193304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-sys\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.193665 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.193618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-lib-modules\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.193754 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.193597 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb698fb1-7c65-4cb3-837f-af17571ee5dd-podres\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.202514 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.202480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqkn\" (UniqueName: \"kubernetes.io/projected/bb698fb1-7c65-4cb3-837f-af17571ee5dd-kube-api-access-ncqkn\") pod \"perf-node-gather-daemonset-gw68h\" (UID: \"bb698fb1-7c65-4cb3-837f-af17571ee5dd\") " pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.250208 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.250175 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.442025 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.441993 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h"] Jul 16 17:59:58.444268 ip-10-0-131-79 kubenswrapper[2579]: W0716 17:59:58.444232 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb698fb1_7c65_4cb3_837f_af17571ee5dd.slice/crio-61f00d2e7b247713272084fa7a93d45c6dace426e1ea6b0b66b91dd4d79379b7 WatchSource:0}: Error finding container 61f00d2e7b247713272084fa7a93d45c6dace426e1ea6b0b66b91dd4d79379b7: Status 404 returned error can't find the container with id 61f00d2e7b247713272084fa7a93d45c6dace426e1ea6b0b66b91dd4d79379b7 Jul 16 17:59:58.462444 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.462403 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/1.log" Jul 16 17:59:58.469490 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.469456 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sqx9h_a72ed6e5-f053-4fff-8d44-e75c4a6191ce/console-operator/2.log" Jul 16 17:59:58.761942 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.761847 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" event={"ID":"bb698fb1-7c65-4cb3-837f-af17571ee5dd","Type":"ContainerStarted","Data":"775711df64bc12f360cdd7e439f36c7ca77ef0f1ebb2e45086acc94c41cc82c4"} Jul 16 17:59:58.761942 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.761913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" event={"ID":"bb698fb1-7c65-4cb3-837f-af17571ee5dd","Type":"ContainerStarted","Data":"61f00d2e7b247713272084fa7a93d45c6dace426e1ea6b0b66b91dd4d79379b7"} Jul 16 17:59:58.761942 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.761937 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 17:59:58.776917 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.776858 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" podStartSLOduration=1.776836769 podStartE2EDuration="1.776836769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:59:58.776387668 +0000 UTC m=+2422.097603857" watchObservedRunningTime="2026-07-16 17:59:58.776836769 +0000 UTC m=+2422.098052928" Jul 16 17:59:58.969122 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:58.969094 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64f5696cd-5fpgc_f109faa8-47b0-4be0-a8ed-bf2025b3a77c/console/0.log" Jul 16 17:59:59.033738 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:59.033664 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-q2nxz_c5732757-e4db-4cf5-a4a4-0d94791abda4/download-server/0.log" Jul 16 17:59:59.629549 ip-10-0-131-79 kubenswrapper[2579]: I0716 17:59:59.629522 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-dtpvd_0b9376c1-6422-4886-93b3-9155ccaf7cb1/volume-data-source-validator/0.log" Jul 16 18:00:00.738514 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:00.738488 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f964c_0c0a9fe5-b012-46d4-9f21-e5a3a8592f19/dns/0.log" Jul 16 18:00:00.768503 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:00.768464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f964c_0c0a9fe5-b012-46d4-9f21-e5a3a8592f19/kube-rbac-proxy/0.log" Jul 16 18:00:00.879220 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:00.879181 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpq8m_a1a3b005-42b7-4098-8e5f-49da0a9abeed/dns-node-resolver/0.log" Jul 16 18:00:01.555109 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:01.555081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z4b9c_9e0c60c3-8e2c-42ce-a438-767c1386938e/node-ca/0.log" Jul 16 18:00:02.502804 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:02.502773 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678rjhbr_ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7/istio-proxy/0.log" Jul 16 18:00:02.622651 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:02.622615 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f558794c5-qqb8v_af7905d4-f5a2-4904-a047-084a36671315/kube-auth-proxy/0.log" Jul 16 18:00:02.686673 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:02.686643 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-f494m_cd11f485-e680-4f65-958a-57df6ed182d0/istio-proxy/0.log" Jul 16 18:00:02.728603 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:02.728567 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-f494m_cd11f485-e680-4f65-958a-57df6ed182d0/istio-proxy/1.log" Jul 16 18:00:02.813222 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:02.813144 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7bc4f64d-dt8h4_15b2c949-fa93-4a22-bb20-bdf8c250d20a/router/0.log" Jul 16 18:00:03.491450 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:03.491421 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9sbhl_7d44c547-b9b3-4cd8-984d-2141e733bd84/serve-healthcheck-canary/0.log" Jul 16 18:00:04.019468 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:04.019427 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-8p5rc_5fec9a68-0ff8-4d95-ab71-ab7a136504f0/insights-operator/0.log" Jul 16 18:00:04.045625 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:04.045577 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwmln_90b7c1e1-6515-4c73-a532-58aaf03696a9/kube-rbac-proxy/0.log" Jul 16 18:00:04.070336 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:04.070306 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwmln_90b7c1e1-6515-4c73-a532-58aaf03696a9/exporter/0.log" Jul 16 18:00:04.099790 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:04.099743 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gwmln_90b7c1e1-6515-4c73-a532-58aaf03696a9/extractor/0.log" Jul 16 18:00:04.783436 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:04.783388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7r7x7/perf-node-gather-daemonset-gw68h" Jul 16 18:00:07.043580 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:07.043555 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qb2gz_4d1548ad-ff25-40cc-b0e8-dd83b3cebe14/server/0.log" Jul 16 18:00:07.123884 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:07.123841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8ffkf_036b64f1-63cb-4011-8b3b-b76452136ec0/manager/0.log" Jul 16 18:00:07.304148 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:07.304114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-875d49b9b-j8gh4_93d99b1a-3b20-45a2-b312-80265eb856ed/manager/0.log" Jul 16 18:00:07.337892 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:07.337867 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-875d49b9b-j8gh4_93d99b1a-3b20-45a2-b312-80265eb856ed/copy-manifests/0.log" Jul 16 18:00:08.620178 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:08.620149 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678rjhbr_ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7/istio-proxy/0.log" Jul 16 18:00:08.716991 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:08.716937 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f558794c5-qqb8v_af7905d4-f5a2-4904-a047-084a36671315/kube-auth-proxy/0.log" Jul 16 18:00:08.763836 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:08.763782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-f494m_cd11f485-e680-4f65-958a-57df6ed182d0/istio-proxy/0.log" Jul 16 18:00:08.799227 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:08.799184 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-f494m_cd11f485-e680-4f65-958a-57df6ed182d0/istio-proxy/1.log" Jul 16 18:00:08.852730 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:08.852696 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7bc4f64d-dt8h4_15b2c949-fa93-4a22-bb20-bdf8c250d20a/router/0.log" Jul 16 18:00:10.139117 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:10.139091 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678rjhbr_ebb9f8a3-f854-4eca-8f47-5ebd2173c1f7/istio-proxy/0.log" Jul 16 18:00:10.245654 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:10.245570 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f558794c5-qqb8v_af7905d4-f5a2-4904-a047-084a36671315/kube-auth-proxy/0.log" Jul 16 18:00:10.287110 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:10.287074 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-f494m_cd11f485-e680-4f65-958a-57df6ed182d0/istio-proxy/0.log" Jul 16 18:00:10.332736 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:10.332699 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-f494m_cd11f485-e680-4f65-958a-57df6ed182d0/istio-proxy/1.log" Jul 16 18:00:10.401382 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:10.401354 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7bc4f64d-dt8h4_15b2c949-fa93-4a22-bb20-bdf8c250d20a/router/0.log" Jul 16 18:00:13.761389 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:13.761354 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-vlp2p_fba80834-4340-43f2-8ede-ac015983c87f/migrator/0.log" Jul 16 18:00:13.782711 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:13.782671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-vlp2p_fba80834-4340-43f2-8ede-ac015983c87f/graceful-termination/0.log" Jul 16 18:00:14.148071 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:14.148027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-kg2zr_8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e/kube-storage-version-migrator-operator/1.log" Jul 16 18:00:14.149031 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:14.149007 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-kg2zr_8e42c4c3-e5f0-4f39-bbc0-c61c3ed9f31e/kube-storage-version-migrator-operator/0.log" Jul 16 18:00:15.380877 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:15.380851 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kp8cv_3ed64c3e-31de-468f-b826-5f5d63db7956/kube-multus-additional-cni-plugins/0.log" Jul 16 18:00:15.431027 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:15.431000 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kp8cv_3ed64c3e-31de-468f-b826-5f5d63db7956/egress-router-binary-copy/0.log" Jul 16 18:00:15.473125 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:15.473075 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kp8cv_3ed64c3e-31de-468f-b826-5f5d63db7956/cni-plugins/0.log" Jul 16 18:00:15.515995 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:15.515968 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kp8cv_3ed64c3e-31de-468f-b826-5f5d63db7956/bond-cni-plugin/0.log" Jul 16 18:00:15.558124 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:15.558092 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kp8cv_3ed64c3e-31de-468f-b826-5f5d63db7956/routeoverride-cni/0.log" Jul 16 18:00:15.598859 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:15.598811 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kp8cv_3ed64c3e-31de-468f-b826-5f5d63db7956/whereabouts-cni-bincopy/0.log" Jul 16 18:00:15.635937 ip-10-0-131-79 kubenswrapper[2579]: I0716 18:00:15.635842 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kp8cv_3ed64c3e-31de-468f-b826-5f5d63db7956/whereabouts-cni/0.log"